NAVAL  POSTGRADUATE  SCHOOL 
Monterey,  California 


THESIS 


PAST  PERFORMANCE  POLICY 

IMPLEMENTATION  AT  THE  PORTSMOUTH 

NAVAL  SHIPYARD 

by 

David  C.  Warunek 

December  1996 

Principal  Advisor; 

Danny  A.  Shockley 

Associate  Advisor; 

MarkW.  Stone 

Approved  for  public  release;  distribution  is  unlimited. 


1 9970626  054 


REPORT  DOCUMENTATION  PAGE  | 


Public  reporting  burden  for  this  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instruction,  searching 
existing  data  sources,  gathering  and  maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding 
this  burden  estimate  or  any  other  aspect  of  this  collection  of  information,  including  suggestions  for  reducing  this  burden,  to  Washington  headquarters 
Services,  Directorate  for  Information  Operations  and  Reports,  1 21 5  Jefferson  Davis  Highway,  Suite  1204,  Arlington,  VA  22202-4302,  and  to  the  Office  of 
Management  and  Budget,  Paperwork  Reduction  Project  (070^01 88)  Washington  DC  20503.  _ _ 


1.  AGENCY  USE  ONLY  (Leave  blank) 


2.  REPORT  DATE 

December  1996 


3.  REPORT  TYPE  AND  DATES  COVERED 

Master’s  Thesis 


4.  TITLE  AND  SUBTITLE 

PAST  PERFORMANCE  POLICY  IMPLEMENTATION  AT  THE  PORTSMOUTH 
NAVAL  SHIPYARD  _ 


6.  AUTHOR(S) 
Wanmek,  David  C. 


7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 
Naval  Postgraduate  School 
Monterey,  CA  93943-5000 


9.  SPONSORING  /  MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 


5.  FUNDING  NUMBERS 


8.  PERFORMING 
ORGANIZATION  REPORT 
NUMBER 


10.  SPONSORING  / 
MONITORING 

AGENCY  REPORT  NUMBER 


11.  SUPPLEMENTARY  NOTES 

The  views  expressed  in  this  thesis  are  those  of  the  author  and  do  not  reflect  the  oflhcial  policy  or  position  of  the  Department  of 
Defense  or  the  U.  S.  Government.  _ 


12a.  DISTRIBUTION  /  AVAILABILITY  STATEMENT  12b.  DISTRIBUTION  CODE 

Approved  for  public  release;  distribution  unlimited.  _ _ 


The  use  of  past  performance  as  a  factor  in  the  source  selection  process  intuitively  makes  sense.  A  contractor’s  record  of 
past  performance  is  a  good  indicator  of  future  performance  and  should  be  used  to  make  best  value  vice  low  cost  contract 
awards.  The  Federal  Government  recognizes  the  value  of  assessing  past  performance  and  mandates  its  use  by  all  agencies. 
This  study  discusses  the  issues  surrounding  the  use  of  past  performance.  It  also  provides  an  overview  of  current  mandatory 
and  discretionary  past  performance  guidance,  and  describes  several  past  performance  information  systems  applicable  to  the 
Portsmouth  Naval  Shipyard,  Portsmouth,  NH,  An  analysis  of  the  shipyard  environment  is  then  used  to  form  the  basis  for  an 
effective  policy  implementation  plan.  Currently  past  performance  shall  be  a  significant  factor  in  all  competitively  negotiated 
procurements  above  one  million  dollars.  Similarly,  evaluations  must  be  prepared  for  each  contract  valued  at  five  hundred 
thousand  dollars  or  above.  These  thresholds  will  soon  be  lowered  to  one  hundred  thousand  dollars  each.  Implementing  the 
highly  discretionary  Federal  policies  at  the  command  level  requires  a  thorough  understanding  of  the  issues  surrounding  past 
performance  such  as  fairness,  the  prescriptive  versus  tailored  approaches,  new  entrant  treatment,  information  validity,  and 
implementation  costs.  Successful  implementation  is  also  dependent  upon  command  specific  needs  and  limitations.  This 
study  investigates  the  issues  surrounding  the  implementation  of  the  Federal  past  performance  policies  at  the  Portsmouth 
Naval  Shipyard. 


14.  SUBJECT  TERMS 

Past  Performance,  Best  Value,  Contractor  Performance  Evaluation,  Past  Performance  Information  Systems 


17.  SECURITY  CLASSIFICATION  OF 
REPORT 

Unclassified 


18.  SECURITY  CLASSIFICATION  OF 
THIS  PAGE 

Unclassified 


19.  SECURITY  CLASSIFI- CATION 
OF  ABSTRACT 

Unclassified 


15.  NUMBER  OF 
PAGES 


16.  PRICE  CODE 


20.  LIMITATION 
OF  ABSTRACT 


NSN  7540-01-280-5500 


Standard  Form  298  (Rev.  2-89) 
Prescribed  by  ANSI  Std.  239-18 


1 


Approved  for  public  release;  distribution  is  unlimited 


PAST  PERFORMANCE  POLICY  IMPLEMENTATION  AT  THE 
PORTSMOUTH  NAVAL  SHIPYARD 


David  C.  Warunek 
Lieutenant,  United  States  Navy 
B.A.,  Penn  State  University,  1988 

Submitted  in  partial  fulfillment  of  the 
requirements  for  the  degree  of 

MASTER  OF  SCIENCE  IN  MANAGEMENT 


fi'om  the 


NAVAL  POSTGRADUATE  SCHOOL 
December  1996 


Author: 


Approved  by: 


Reuben  T.  Harris,  Chairman 
Systems  Management  Department 


ABSTRACT 


The  use  of  past  performance  as  a  factor  in  the  source  selection  process  intuitively  makes 
sense.  A  contractor’s  record  of  past  performance  is  a  good  indicator  of  future  performance 
and  should  be  used  to  make  best  value  vice  low  cost  contract  awards.  The  Federal 
Government  recognizes  the  value  of  assessing  past  performance  and  mandates  its  use  by  all 
agencies.  This  study  discusses  the  issues  surrounding  the  use  of  past  performance.  It  also 
provides  an  overview  of  current  mandatory  and  discretionary  past  performance  guidance,  and 
describes  several  past  performance  information  systems  applicable  to  the  Portsmouth  Naval 
Shipyard,  Portsmouth,  NH.  An  analysis  of  the  shipyard  environment  is  then  used  to  form  the 
basis  for  an  effective  policy  implementation  plan.  Currently  past  performance  shall  be  a 
significant  factor  in  all  competitively  negotiated  procurements  above  one  million  dollars. 
Similarly,  evaluations  must  be  prepared  for  each  contract  valued  at  five  hundred  thousand 
dollars  or  above.  These  thresholds  Avill  soon  be  lowered  to  one  hundred  thousand  dollars 
each.  Implementing  the  highly  discretionary  Federal  policies  at  the  command  level  requires  a 
thorough  understanding  of  the  issues  surrounding  past  performance  such  as  fairness,  the 
prescriptive  versus  tailored  approaches,  new  entrant  treatment,  information  validity,  and 
implementation  costs.  Successful  implementation  is  also  dependent  upon  command  specific 
needs  and  limitations.  This  study  investigates  the  issues  surrounding  the  implementation  of 
the  Federal  past  performance  policies  at  the  Portsmouth  Naval  Shipyard. 
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INITIAL  DISTRIBUTION  LIST 


1.  INTRODUCTION 


A.  PURPOSE 

The  primary  purpose  of  this  research  is  to  explore  the  issues  surrounding  the  Federal 
Government’s  mandatory  use  of  past  performance  as  a  factor  in  the  source  selection  process, 
and  to  develop  a  strategy  that  would  enable  the  Portsmouth  Naval  Shipyard  (PNSY), 
Contracting  Division,  to  successfully  implement  a  program  which  would  conform  to  all 
mandatory  and  pertinent  discretionary  guidance.  Contractor  past  performance  evaluation,  as 
with  other  acquisition  reform  or  “best  practices”  approaches,  requires  serious  consideration 
of  a  multitude  of  factors  prior  to  adopting  it  and  initiating  changes  within  an  organization. 
Factors  such  as  mandatory  versus  discretionary  guidance,  business  area  analysis,  lessons 
learned,  existing  and  future  data  collection  and  retrieval  systems,  and  fairness  must  be 
considered  in  order  to  make  intelligent  decisions  about  the  commitment  of  personnel  and 
material  resources.  The  purpose  of  this  research  is  to  enable  PNSY  to  comply  with  the 
regulations,  and  to  thoughtfully  consider  the  issues  and  the  current  environment  in  order  to 
reap  the  benefits  for  which  the  regulations  came  into  being. 

B.  BACKGROUND 

Contractor  past  performance  is  intuitively  a  viable  predictor  of  future  performance 
on  a  given  contract.  In  practice  however,  the  use  of  past  performance  information  as  a  source 
selection  criterion  can  vary  greatly  between  contracting  activities  or  between  contracts.  In 
its  most  fundamental  application,  past  performance  information  is  used  in  determining 
contractor  responsibility  prior  to  selection  or  award.  [Ref  1 :  Subpart  9. 104]  A  much  more 
involved  application  would  be  to  evaluate  past  performance  information  as  a  factor  in  the 
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source  selection  process  and  weight  it  according  to  what  the  contracting  officer  (CO) 
determines  to  be  an  appropriate  amount.  Theoretically,  this  could  approach  one  hundred 
percent,  provided  a  waiver  was  received  for  quality,  and  cost  or  price  was  minimized.  [Ref 
l;Subpart  15.605] 

As  a  practical  matter,  existing  past  performance  regulation  and  policy  is  derived  from 
the  Office  of  Federal  Procurement  Policy  Letter  92-5.  [Ref  2]  Subsequent  to  its  issuance, 
twenty  Government  Departments  signed  a  pledge  to  make  past  performance  a  major  selection 
criterion  in  the  award  of  sixty  contracts  during  1994  and  1995.  [Ref  3]  Ten  months  later, 
statutory  language  appeared  in  the  Federal  Acquisition  Streamlining  Act  (FASA)  which 
“acknowledged”  the  relevance  of  past  performance  information  in  the  source  selection 
process  and  encouraged  contracting  officials  to  consider  it.  [Ref  4]  The  basic  rule,  applied 
as  of  this  writing,  mandates  the  use  of  past  performance  information  as  a  source  selection 
factor  for  all  contract  awards  above  five  hundred  thousand  dollars.  This  threshold,  which  will 
be  revised  to  one  hundred  thousand  dollars  on  1  January  1999,  compels  contracting 
organizations  to  include  past  performance  as  a  measure  of  a  contractor’s  ability  to  fulfill  the 
terms  of  the  contract.  [Ref  1:  Subpart  15.608]  Implicit  within  this  mandate  is  the  notion  that 
a  contractor’s  ability  to  perform  well  or  poorly  in  the  past  must  be  significant  to  the  contract 
at  hand,  and  that  it  is  a  factor  in  providing  the  best  value  to  the  Government.  [Ref  3;p.  3] 

Given  that  there  is  an  ample  collection  of  statutory  and  regulatory  guidance  which 
outlines  the  importance  of  past  performance  information  and  requires  its  use  in  source 
selections,  the  focus  shifts  to  a  variety  of  functional  issues.  [Ref  3]  [Ref  5]  [Ref  2]  [Ref  3] 
Some  of  these  issues  which  have  been  the  source  of  much  debate  throughout  the  public  and 
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private  sectors  include;  (1)  how  a  contracting  organization  or  program  might  evaluate  past 
performance  according  to  a  set  of  standards,  (2)  how  the  past  performance  information 
should  be  recorded,  (3)  how  the  data,  once  stored,  can  be  retrieved  and  utilized  by  the  buying 
organization  without  undue  complication  or  expense,  and  (4)  how  much  weight  the  factor 
should  be  given.  Many  individual  solutions  to  the  problem  of  simply  implementing  the 
policies  could  be  produced  throughout  the  Department  of  Defense  (DOD).  The  establishment 
of  “one  size  fits  all”  standards  could  resolve  some  of  the  issues,  but  estabhshing  a  system 
which  makes  sense  and  feirly  produces  the  desired  effidencies  and  economies  requires  a  more 
thoughtful  approach.  A  thorough  analysis,  that  helps  to  provide  answers  to  the  plethora  of 
questions  surrounding  the  policy,  is  required  prior  to  recommending  a  specific  past 
performance  policy  in  support  of  the  source  selection  process  at  the  PNSY  Contracting 
Division. 

C.  POLICY  OVERVIEW 

The  basic  policy  can  be  divided  into  two  primary  elements:  first,  the  requirement  for 
contracting  organizations  to  prepare  evaluations  subsequent  to  contract  performance;  second, 
the  requirement  to  utilize  past  performance  information  in  the  source  selection  process.  [Ref 
1: Subpart  42.15;  15.605]  It  is  important  to  note  that  the  milestone  requirement  to  start 
collecting  the  past  performance  information  precedes  the  requirement  to  utilize  the 
information  at  and  below  the  $500,000  levels.  Theoretically  this  allows  for  the  establishment 
of  a  pool  of  evaluations  prior  to  the  requirement  to  use  them.  The  following  is  a  summary 
of  the  basic  mandatory  guidance  in  effect  as  of  this  writing; 
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1. 


Evaluations 


An  important  aspect  of  the  basic  requirement  provides  for  the  collection  and 
compilation  of  contractor  performance  data.  Agencies  are  required  to  prepare  an  evaluation, 
“at  the  time  the  work  under  the  contract  is  completed,”  for  each  contract  above  the 
$500,000  threshold,  as  of  1  July  1996.  Commencing  1  January  1998,  this  threshold  will  be 
reduced  to  $100,000.  In  order  to  provide  current  information  for  source  selection  purposes, 
interim  evaluations  “should”  also  be  prepared  for  contracts  with  periods  of  performance  over 
one  year.  Exceptions  to  this  rule  include  acquisitions  awarded  under  Federal  Acquisition 
Regulations  (FAR)  Part  8.6  or  8.7;  that  is,  the  Federal  Prison  Industries  Inc.  (UNICOR)  and 
nonprofit  agencies  employing  people  who  are  blind  or  severely  disabled.  [Ref  1: Subpart 
42.1502] 

2.  Utilization 

As  of  1  July  1995  past  performance  must  be  evaluated  for  each  competitively 
negotiated  procurement  expected  to  exceed  $1,000,000.  This  threshold  is  expected  to  be 
reduced,  pending  further  revision,  to  $500,000  on  1  July  1997  and  to  $100,000  on  1  January 
1999.  This  requirement  essentially  adds  another  mandatory  source  selection  factor,  cost  or 
price  and  quality  being  the  other  two,  unless  the  contracting  officer  documents  in  the  contract 
file  why  past  performance  should  not  be  used.  Agencies  have  “broad  discretion”  in  selecting 
the  number  of  factors  and  their  weighting  so  long  as  they  have  a  desired  impact  on  the  source 
selection  decision.  Agencies  also  have  the  option  of  developing  their  own  implementation 
schedule  provided  it  falls  within  the  aforementioned  milestone.  [Ref  1: Subpart  15.605] 
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D.  DEFINITIONS 


1.  Past  Performance  Information 

Although  a  variety  of  factors  make  up  contractor  past  performance  information,  a 
working  definition  from  OFPP  Policy  Letter  92-5  is  provided  in  order  draw  the  appropriate 
mental  borders  around  the  issue. 

Past  performance  information  (PPI)  is  relevant  information  regarding  a 
contractor’s  actions  under  previously  awarded  contracts.  It  includes  the 
contractor’s  record  of  conforming  to  specifications  and  to  standards  of  good 
workmanship;  the  contractor’s  record  of  containing  and  forecasting  costs  on 
any  previously  performed  cost  reimbursable  contracts;  the  contractor’s 
adherence  to  contract  schedules,  including  the  administrative  aspects  of 
performance;  the  contractor’s  history  for  reasonable  and  cooperative 
behavior  and  commitment  to  customer  satisfaction;  and  generally,  the 
contractor’s  business-like  concern  for  the  interest  of  the  customer. 


'  PPI  can  be  obtained  fi'om  a  variety  of  sources.  The  following  list  represents  the 
primary  sources  and  briefly  describes  them; 


•  Government  Evaluations—prepared  as  a  result  of  the  FAR  requirements 

•  References— Government,  Commercial,  and  State/Local  references  obtained  about 
an  offeror’s  performance  on  a  given  contract  or  contracts 

•  Past  Performance  Information  Systems— Automated  or  manual  data  bases 
containing  performance  information  on  quality,  delivery,  cost,  and  a  variety  of 
factors 

•  Contract  Files— In-house  information  that  has  been  retained  from  previous 
contracts  with  the  offeror 

•  Commercial  Supplier  Performance  Reviews— Information  purchased  from 
commercial  sources 
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•  Contract  Administration  Information  Systems—Information  obtained  from  contract 
administration  organizations  such  as  award/incentive  fee  data,  cost  and  schedule 
tracking  data,  and  contract  close-out  histories 

As  indicated,  source  selection  officials  can  utilize  information  from  a  great  number 
of  sources  and  in  a  variety  of  formats.  Market  research  results,  phone  and  correspondence 
diaries,  and  litigation  results  may  also  be  of  value. 

2.  Past  Performance  Information  System 

A  past  performance  information  system  (PPIS)  is  “an  ongoing  effort  to  collect  and 
record  past  performance  information  for  subsequent  use  in  determining  contractor  eligibility 
and  selection.”  [Ref  6]  Within  this  description  three  types  of  systems  are  identified; 

a.  Performance  Appraisal  System— contains  evaluations  prepared  by  cognizant 
Government  officials  subsequent  to  contract  performance.  [Ref  6] 

b.  Performance  Tracking  System— primarily  quality  and  delivery  data  which 
is  extracted  from  data  bases  for  the  purposes  of  source  selection.  [Ref  6] 

c.  Performance  Certification  System— an  established  set  of  criteria  which  are 
applied  to  contractors  for  the  purposes  of  identifying  high  levels  of  performance.  [Ref  6] 

The  aforementioned  categories  are  provided  in  order  to  aid  in  the  classification  of  the 
existing  systems  listed  in  Chapter  IE. 

3.  General 

For  the  purposes  of  this  research,  the  term  “agency”  can  be  applied  to  a  particular 
branch  of  the  Armed  Forces,  the  DOD,  or  other  Government  element  which  is  empowered 
to  implement  Federal  past  performance  policies.  Likewise,  “department”  can  be  used  to 
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describe  a  particular  Service  or  the  DOD.  These  terms  are  used  in  this  manner  to  facilitate 
the  discussion  of  the  latitude  which  all  agencies  have  with  regard  to  implementing  a  particular 
past  performance  program. 

E.  RESEARCH  QUESTIONS 

1.  Primary 

How  could  the  elements  of  the  Federal  Government’s  policy  with  regard  to  utilizing 
contractor  past  performance  data  in  the  source  selection  process,  be  most  efficiently  and 
effectively  implemented  at  the  Portsmouth  Naval  Shipyard? 

2.  Subsidiary 

a.  What  are  the  issues  associated  with  the  collection  and  utilization  of 
contractor  past  performance  information  in  the  source  selection  process? 

b.  What  are  the  current  statutory.  Federal,  departmental,  agency,  and  local 
policies  with  regard  to  contractor  past  performance  measurement,  utilization,  storage,  and 
retrieval? 

c.  What  past  performance  information  systems  are  currently  available  and 
what  are  their  capabilities? 

d.  What  is  the  current  environment  in  which  PNSY  operates,  and  how  does 
it  impact  the  implementation  of  Federal  past  performance  policies? 
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F.  SCOPE  AND  LIMITATIONS 


Although  many  of  the  issues  and  regulations  addressed  in  this  research  apply  to  the 
generic  contracting  organization,  a  departure  was  made  from  this  approach  with  regard  to 
specific  aspects  of  program  tailoring,  business  area  analysis,  and  policy  implementation  at 
PNSY.  The  reader  should  therefore  not  expect  all  issues  identified  in  Chapter  II  to  be 
completely  associated  with  an  action  within  the  implementation  recommendations.  PNSY’ s 
Contracting  Division  does  not  face  the  same  challenges  nor  conduct  business  on  the  same 
scale  as  do  major  weapon  systems  Program  Managers  or  System  Commanders.  Lessons 
learned  and  best  practices  information  however,  is  utilized  whenever  applicable. 

Additionally,  due  to  the  downsizing  of  PNSY,  as  well  as  the  rest  of  DOD,  business 
area  data  were  utilized  from  fiscal  years  1995  and  1996  as  a  baseline  vice  older  data  which 
would  reflect  either  a  much  larger  Navy  or  a  series  of  decommissionings  which  are  not 
anticipated  in  the  immediate  future.  Another  significant  change  in  the  business  area  will  be 
the  absence  of  Foreign  Military  Sales  (FMS)  in  the  immediate  future.  Finally,  the  basic 
organization  and  reporting  relationships  of  the  Contracting  Division  and  PNSY  appear  to  be 
in  flux  due  to  the  current  push  for  the  regional  maintenance  concept,  and  therefore  the 
recommendations  are  based  on  a  snapshot  of  PNSY  as  it  exists  during  this  writing.  [Ref.  7] 
G.  METHODOLOGY 

Initial  research  was  conducted  by  reviewing  all  Federal,  departmental,  agency,  and 
organizational  policy  related  citations,  both  electronic  and  hard  copy,  in  order  to  ascertain 
the  current  status  of  past  performance  guidance.  Next  a  variety  of  search  engines  were 
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utilized,  via  the  Internet,  to  locate  any  acquisition  reform  or  best  practices  related  web  sites 
which  contained  past  performance  information.  Information  was  also  obtained  regarding 
existing  and  planned  past  performance  evaluation  systems.  Numerous  phone  interviews  and 
a  visit  to  PNS  Y  were  then  accomplished  in  order  to  gain  insight  into  the  practices  in  place  and 
the  internal  and  external  environments  of  the  PNSY  Contracting  Division.  An  historical 
analysis  of  all  contract  actions  above  the  one  hundred  thousand  dollar  threshold  then  revealed 
the  business  areas  in  which  to  focus  specific  strategies  for  policy  implementation.  Concurrent 
with  all  of  the  above  was  a  continual  search  for  lessons  learned  and  a  constant  effort  to  keep 
abreast  of  (1)  the  proposed  changes  to  both  the  Federal  Acquisition  Regulations  (FAR)  and 
the  Defense  Federal  Acquisition  Regulation  Supplement  (DFARS),  and  (2)  the  sometimes 
volatile  atmosphere  which  could  possibly  predict  the  ultimate  course  which  regulatory  bodies 
might  take.  Phone  interviews  with  the  Defense  Acquisition  Regulations  (DAR)  Council  and 
members  of  the  Past  Performance  Coordinating  Council  (PPCC)  seemed  to  be  the  best  “bell 
weathers”  available  to  determine  which  regulations  may  apply  in  the  near  future.  The 
preponderance  of  discretionary  guidance  was  taken  from  two  sources;  the  Office  of  Federal 
Procurement  Policy  (OFPP)  Best  Practices  Guide  for  Past  Performance  and  the  Arthur  D. 
Little  report  on  Contractor  Past  Performance  Systems  Evaluation.  [Ref  3]  [Ref  6] 

H.  ORGANIZATION  OF  STUDY 

Chapter  11  outlines  the  myriad  of  issues  surrounding  the  mandatory  inclusion  of  past 
performance  in  the  source  selection  process  from  both  the  Government  and  contractor 
perspectives.  The  researcher  attempted  to  marry  an  appropriate  “answer”  to  each  issue  by 
utilizing  the  mandatory  and  discretionary  guidance  available.  This  chapter  is  intended  to 
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compare  the  potential  problems  or  benefits  created  by  past  performance  evaluation,  and  the 
guidance  created  to  mitigate  the  problems. 

Chapter  HI  provides  an  overview  of  the  current  past  performance  information  systems 
and  briefly  describes  how  they  would  apply  to  PNSY. 

Chapter  IV  outlines  the  shipyard  and  contracting  office  environments  and  identifies 
the  particular  business  areas  which  may  be  affected  by  Federal  past  performance  policies.  An 
analysis  is  provided  to  determine  what  PNSY  needs  with  regard  to  the  elements  of  an 
appropriate  implementation  strategy. 

Chapter  V  outlines  a  strategy  that  is  intended  to  successfully  implement  the  current 
past  performance  policies  at  PNSY  while  taJdng  into  account  command  specific  issues  as  well 
as  general  concerns.  Recommended  actions  are  based  on  the  status  of  past  performance 
policies  and  on  the  changing  environment  of  PNSY. 

Chapter  VI  summarizes  the  main  points  of  the  research  and  addresses  each  thesis 
question.  General  conclusions  and  additional  recommendations  are  provided,  and  areas  for 
further  research  are  addressed. 
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n.  ISSUES  AND  ANSWERS 


A.  INTRODUCTION 

The  use  of  contractor  past  performance  information  (PPI)  in  the  source  selection 
process  intuitively  seems  to  make  good  sense.  If  a  contractor  was  able  to  consistently  provide 
superior  goods  or  services  in  the  past,  and  was  able  to  deliver  them  on  time  with  minimal 
oversight,  and  at  the  quoted  price,  then  there  should  be  no  question  as  to  the  Government’s 
inclination  to  utilize  the  same  contractor  in  the  foture  for  similar  goods  or  services.  Likewise, 
if  a  contractor  has  performed  poorly  in  the  past  and  exhibited  a  trend  of  cost  overruns,  late 
deliveries,  poor  quality,  and  strained  business  relations,  the  Government  would  not,  and 
should  not,  competitively  award  to  that  contractor.  If  all  contractors  could  be  classified  into 
either  of  the  aforementioned  categories  through  the  use  of  easily  obtainable,  form  fitting,  and 
relevant  past  performance  information,  then  the  source  selection  process  would  likely  be 
greatly  simplified.  In  practice  however,  it  seems  unreasonable  to  expect  that  such  “perfect” 
information  would  be  available  across  the  vast  spectrum  of  Government  procurements.  Such 
scenarios  also  beg  the  question  as  to  the  predictive  qualities  of  PPI  with  regard  to  future 
contract  success.  Consequently,  there  are  a  plethora  of  issues  surrounding  the  mandatory 
inclusion  of  past  performance  as  a  factor  in  the  source  selection  process.  The  following  is  a 
discussion  of  some  of  the  more  prevalent  issues  with  a  corresponding  “answer”  provided  via 
existing  mandatory  or  discretionary  guidance.  The  methodology  for  identifying  a  topic  as  an 
issue  was  primarily  based  on  a  review  of  the  guidance  provided  by  OFPP  and  the  FAR, 
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interviews,  informal  classroom  and  personal  discussions,  and  various  written  opinions.  The 
issues  cited  can  generally  be  attributed  to  any  number  of  sources,  including  the  researcher. 
B.  INFORMATION  RELEVANCE 

Before  unconditionally  accepting  the  notion  that  past  performance  information,  in  the 
broad  sense,  is  an  appropriate  indicator  of  a  contractor’s  ability  to  successfully  complete  the 
requirements  of  a  particular  contract,  it  is  necessary  to  establish  its  relevance.  Comprising 
this  issue  are  the  subsidiary  concepts  of  PPI  as  a  valid  predictor  and  its  appropriate 
application. 

1.  Predictive  Validity 

The  question  has  to  be  asked:  “Who  says  past  performance  is  a  such  a  good  predictor 
of  future  contract  performance?”  It  should  not  necessarily  be  taken  for  granted  that  past 
performance  is  an  effective  measure  of  a  contractor’s  ability  to  perform  in  the  future.  As 
contracting  professionals  we  should  not  simply  accept  new  policies  without  trying  to 
understand  or  challenge  their  validity  [Ref  8]  To  examine  and  resolve  this  issue  a  common 
analogy,  a  litigation  result,  and  the  sentiments  of  numerous  leaders  are  cited. 
a.  Performance  Appraisals 

It  may  be  difficult  to  argue  with  the  concept  of  past  performance  assessment 
as  a  common  basis  for  reward  in  our  society.  Performance  evaluations  are  routinely  produced 
throughout  industry  and  the  military  in  order  to  document  a  person’s  ability  to  comply  with 
the  terms  of  employment.  Such  evaluations  are  also  used  to  reward  employees,  often  times 
competitively,  with  promotions,  transfers,  cash,  and  the  like.  It  also  makes  good  business 
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sense  to  afford  those  with  a  record  of  superior  past  performance  an  opportunity  to  continue 
in  that  evaluated  capacity,  or  one  of  similar  or  increased  responsibility,  so  that  the  positive 
results  can  be  reaped  again.  Similarly,  and  sometimes  consequently,  poorly  evaluated 
employees  should  not  be  rewarded  nor  should  they  be  given  the  opportunity  to  continue 
performing  to  the  detriment  of  the  employer.  Although  the  positive  aspects  of  this  analogy 
could  translate  well  to  the  Government’s  use  of  PPI  via  the  contract  award/reward  features, 
so  could  the  negative  aspects.  Performance  evaluations  are  often  inflated  or  may  include 
non-descriptive  or  non-distinctive  “cookie  cutter”  comments.  There  are  also  biases  with 
regard  to  favoring  certain  employees  over  others,  or  citing  only  favorable  instances  or  the 
most  recent  instances  vice  trends  of  performance.  Additionally  new  employees  are  sometimes 
at  a  disadvantage  comparatively,  as  rankings  often  favor  more  senior  employees.  All  of  the 
aforementioned  negative  aspects  can  of  course  affect  the  predictive  validity  of  PPI.  [Ref.  9] 
But  just  as  employee  evaluations  are  not  prepared  without  well-intentioned  guidance,  past 
performance  evaluations  and  evaluation  procedures  are  guided  by  regulations  and 
recommendations  which  are  discussed  below.  [Ref.  l:Subpart  42.15;  15.6][Ref  3] 

b.  Comptroller  General 

In  a  relatively  recent  case.  May  1 996,  the  Comptroller  General  of  the  United 
States  helped  validate  the  use  of  past  performance  in  the  source  selection  process.  A  protest 
which  sought  to  stop  the  award  of  a  hotel  services  contract,  on  the  grounds  that  past 
performance  was  used  in  the  competitive  negotiation  vice  price  alone,  was  denied.  The 
protester  contended  that  because  sealed  bids  were  used  previously,  where  price  alone  was 
considered,  including  past  performance  in  the  source  selection  in  question  provided  the 
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incumbent  with  an  unfair  advantage;  especially  since  past  performance  was  weighted  more 
heavily  than  price.  In  short  the  Comptroller  General  thought  that  it  was  reasonable  for  the 
contracting  officer  to  assume  that  there  was  a  correlation  between  the  quality  of  service  that 
could  be  expected  from  the  offerors  and  the  offerors’  past  performance.  [Ref  10]  This 
decision  effectively  validates  the  notion  that  past  performance  is  of  value  in  the  source 
selection  process,  at  least  as  much  as  price.  It  also  serves  to  set  a  precedent  for  contracting 
officers  who  would  likely  worry  about  assigning  a  significant  weighting  to  the  past 
performance  factor. 

c.  Leadership  Validation 

Although  not  the  first  to  acknowledge  the  importance  of  past  performance  in 
the  source  selection  process,  the  President  of  the  United  States  included  the  topic  as  one  of 
a  series  of  measures  designed  to  “ensure  effective  and  efficient  spending  of  public  funds.” 
[Ref  5]  This  acknowledgment  was  consistent  with  the  recommendations  of  the  Vice 
President’s  National  Performance  Review  which  sparked  a  maelstrom  of  Federal  procurement 
reform  initiatives.  The  Executive  Office  of  the  President,  that  is  the  Office  of  Management 
and  Budget  (0MB),  actually  established  the  importance  of  past  performance  much  earlier  by 
stating  that  it  was  a  “key  indicator  for  predicting  future  performance.” 

[Ref  2] 

Leaders  in  the  private  sector  also  advocate  the  use  of  past  performance  in  source 
selections.  Norm  Augustine,  Chief  Executive  Officer  (CEO)  of  Lockheed  Martin 
International  Corporation  and  arguably  the  Commander  in  Chief  of  the  defense  industry, 
believes  that  the  commercial  practice  of  “placing  great  credence  in  a  supplier’s  past 
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performance”  is  an  essential  element  of  successful  acquisition  reform.  [Ref.  1 1]  In  support  of 
this  contention  is  the  following  partial  list  of  companies  used  as  benchmarks  to  model  the 
DOD’s  past  performance  evaluation  systems:  Black  and  Decker  Corporation,  Boeing  Defense 
and  Space  Group,  Ford  Motor  Company,  McDonnell  Douglas  Corporation,  Mobil 
Corporation,  and  Rockwell  Defense  Electronics.  [Ref  6:p.  26]  These  companies  have  come 
to  the  realization  that  past  performance  is  an  important  factor  in  selecting  suppliers,  especially 
given  that  materials  purchased  account  for  approximately  40%  to  60%  of  sales.  [Ref  6;p.  5] 

2.  Information  Source  Applicability 

Making  the  assumption  that  a  collection  of  PPI  is  accurate  is  another  part  of  the 
overall  relevance  determination.  This  same  information  might  be  unmatched  to  the  target 
organization  or  contract.  The  past  performance  of  a  particular  division  within  a  company  may 
not  be  suitably  applied  to  the  evaluation  of  an  entire  organization.  Likewise,  key  personnel 
are  often  transferred  as  companies  are  merged  and  dissolved  on  a  frequent  basis.  This 
complicates  the  ideal  situation  that  would  allow  data  to  be  collected  about  the  same  people, 
the  same  factory,  the  same  division,  etc.  who  performed  the  identical  processes  in  the  past. 
Ideal  information  may  not  be  available  from  the  contracting  officer’s  perspective,  but  may  be 
provided  as  such  by  an  offeror.  Conversely,  the  contracting  officer  may  wish  to  cite  instances 
of  poor  performance  from  a  particular  division,  subsidiary,  or  factory,  while  the  contractor 
prefers  a  corporate  evaluation.  The  evaluator  must  place  an  emphasis  on  selecting  the 
appropriate  source  of  PPI. 

The  past  performance  of  key  management  and  operating  personnel  should  be  looked 
at  as  an  indicator  of  how  well  the  contract  might  be  performed.  This  is  also  important  with 
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regard  to  new  entrants  as  this  may  be  a  method  of  evaluating  the  risk  involved  with  selecting 

a  company  with  no  relevant  experience.  [Ref.  3:p.l4]  With  regard  to  corporate  versus 

divisional  performance,  an  agency  must  determine  the  degree  of  control  that  a  parent 

organization  has  or  will  exert  over  the  affiliate. 

If  a  parent  organization  has  an  excellent  or  poor  performance  record  and 
the  affiliate  is  going  to  be  closely  controlled  and  managed  by  the  parent, 
then  the  agency  should  consider  the  parent  organization’s  performance 
record  in  making  the  performance  decision.  [Ref  3  :p.  16] 

C.  EVALUATIONS 

It  is  fairly  simple  to  say  that  a  contractor’s  performance  will  be  evaluated  after  each 
contract  and  that  the  information  may  determine  the  award  of  future  contracts.  This 
inherently  creates  the  need  for  some  type  of  document  or  collection  of  data  that  can  be 
utilized  by  contracting  organizations  to  make  critical,  and  perhaps  expensive,  source 
selection  decisions.  Information  contained  in  such  evaluation  documents  or  data  sets  must 
be  accurate  and  complete,  reflecting  the  results  of  some  fair  process  that  is  truly  indicative  of 
a  contractor’s  ability  to  perform  for  the  Government  in  the  future.  Thus  are  created  many  of 
the  questions  surrounding  the  actual  evaluation. 

1.  Tailored  Versus  Prescribed  Format 

The  heart  of  the  issue  is  whether  there  should  be  a  prescribed  or  universal  evaluation 
format  versus  one  tailored  to  the  individual  department,  service,  command  or  even  the 
individual  contract.  The  primary  advantage  of  having  a  standardized  version  is  that  data  can 
be  readily  applied  to  a  common  form  for  ease  of  extraction  and  comparison.  This  is  especially 
important  when  utilizing  automated  data  processing  systems,  discussed  in  Section  D  below. 
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as  data  fields  need  to  be  transferred  from  one  system  to  another.  The  main  problem  with 
using  a  standard  format  is  that  the  collector  or  evaluator  is  forced  to  make  whatever  variety 
of  data  fit  the  mold  or  template  that  is  provided.  To  apply  an  evaluation  format  standard 
across  the  multitude  of  commodities  and  procurement  actions  in  which  the  Federal 
Government,  or  even  the  DOD,  engages  is  likely  to  produce  distortions  and  ambiguities. 
Likewise  the  standard  evaluation  would  have  to  incorporate  a  sufficient  number  of  evaluation 
subfactors  so  that  an  accurate  “picture”  of  a  contractor’s  performance  is  produced.  These 
issues  suggest  that  a  tailored  approach  might  produce  more  accurate  information.  The 
caution  here  is  that  the  benefits  received  through  the  expeditious  and  efScient  sharing  of 
information  among  agendes  would  likely  be  decreased.  Essentially  a  tradeoff  exists  between 
incorporating  the  optimum  number  and  style  of  rating  areas  and  rating  criteria  within  a 
selected  format,  and  the  resources  required  to  produce,  archive,  and  collect  the  evaluations. 

a.  Rating  Areas 

Mandatory  guidance  on  this  issue  provides  that  agencies  are  responsible  for 
tailoring  the  evaluations  to  the  size,  content,  and  complexity  of  the  contractual  requirements. 
[Ref  1 :  Subpart  42. 1502]  The  FAR  does  not  prescribe  actual  rating  areas  but  does  elaborate 
on  what  PPI  includes;  that  is,  standards  of  good  workmanship  (quality),  the  contractor’s 
record  of  forecasting  and  controlling  costs  (cost  control),  adherence  to  contract  schedules 
(timehness),  business  relations,  and  customer  satisfaction.  The  DOD’s  response  to  this  was 
to  prepare  proposed  DFARS  language,  see  appendix  A,  that  will  establish  a  general  format 
for  evaluations  consisting  of  five  rating  areas;  quality,  cost  control,  timeliness,  business 
relations,  and  an  overall  assessment.  All  areas  except  business  relations  were  to  be  considered 
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mandatory.  [Ref.  12]  Discretionary  guidance  from  OFPP,  which  preceded  the  DFARS 
proposed  language,  recommended  a  system  with  all  of  the  aforementioned  areas  but  with 
customer  satisfection  and  key  personnel  as  additional  areas  to  be  rated.  In  general  it  appears 
that  cost,  quality,  and  delivery/timeliness  are  common  throughout  both  Government  guidance 
and  commercial  practice.  [Ref  6:p.  29]  Given  that  selecting  the  rating  areas  for  an  evaluation 
is  currently  up  to  the  discretion  of  the  agency,  the  question  turns  to  how  any  coordinated 
approach  to  establishing  a  uniform  or  at  least  compatible  format  is  possible.  Likewise  the 
number  and  style  of  rating  criteria  are  called  into  question. 

b.  Scoring  Criteria 

This  issue  relates  to  the  same  decision  that  source  selection  officials  need  to 
make  regarding  the  rating  criterion  or  scoring  of  the  proposal  in  general.  Provided  that  the 
method  chosen  is  rational  and  can  be  supported  by  documentation,  the  adjectival,  numerical, 
ranking,  and  color  coding  systems  seem  to  be  the  major  classifications.  [Ref  1  ;Supart  1 5.612] 
[Ref.  13;p.l56]  It  is  generally  up  to  the  discretion  of  the  agency  conducting  the  source 
selection  to  select  the  system  best  suited  to  the  solicitation  at  hand.  This  is  a  problem  as  a 
case  can  usually  be  made  for  utilizing  any  scoring  system  over  another.  Different  systems  do 
not  lend  themselves  well  to  sharing  information  via  any  type  of  automated  data  system.  The 
number  of  gradations,  the  definition  of  adjectives  or  colors,  and  the  number  of  offerors 
involved  in  the  process  could  conceivably  be  different  for  each  source  selection.  As 
previously  mentioned,  it  is  up  to  the  agency  to  tailor  the  evaluation  to  the  individual  contract 
if  desired,  but  without  some  form  of  specific  guidance  on  how  the  rating  areas  should  look, 
the  problem  of  incompatibility  will  be  perpetuated.  The  DOD  response  was  to  include  a 
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specific  scoring  technique  in  the  proposed  DFARS  language.  Adjectival  ratings  were 
prescribed  for  use  within  each  area:  unsatis&ctory,  marginal,  satisfactory,  and  excellent.  [Ref 
12]  Although  the  implementation  of  this  proposed  language  is  currently  suspended  [Ref  14], 
the  evaluation  format  prescribed  is  similar  to  that  proposed  by  OFPP  via  its  Contractor 
Performance  Report  (CPR).  [Ref  3:p.  A3]  OFPP  also  recommended  a  category  of  “excellent 
plus”  to  further  distinguish  superior  past  performance.  Even  if  one  considered  these  five 
specific  rating  criteria  sufficient,  the  issue  then  turns  to  the  definition  of  such  adjectives.  The 
proposed  DFARS  language  for  example  indicated  that  -within  the  area  of  quality,  an  excellent 
rating  would  indicate  that  there  were  “no  quality  problems.”  What  constitutes  a  problem? 
It  is  unlikely  that  within  a  major  weapon  system  acquisition  covering  potentially  thousands 
of  deliverables  and  processes,  multiple  subcontractors,  and  multiple  years  that  a  single  quality 
problem  could  not  have  arisen.  With  smaller  procurements  of  piece/parts  or  single 
commodities,  this  criterion,  in  its  literal  interpretation,  could  possibly  be  sustained.  To 
reiterate,  there  is  such  a  broad  spectrum  of  procurements  and  acquisitions  across  the  Federal 
Government  and  DOD  that  a  prescriptive  approach  has  many  weaknesses. 

2.  Resources 

A  major  consideration  with  regard  to  the  latitude  afforded  contracting  officers  in  the 
evaluation  process  involves  the  resources  required  to  prepare,  maintain,  and  share  them. 
Additional  direction,  or  at  least  a  clear  vision,  is  required  in  order  to  prevent  organizations 
from  wasting  resources  while  designing  individual  solutions.  [Ref  15]  If  ten  contracting 
shops  come  up  with  ten  different  formats  utilizing  different  data  base  software  and  descriptive 
definitions,  and  a  uniform  system  is  prescribed  later,  the  majority  of  the  contracting 
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organizations  would  have  to  either  change  or  terminate  their  existing  programs.  The  labor 
associated  with  implementing  a  new  system,  changing  the  new  system,  and  continuing  the 
new  system  are  all  costs  associated  with  the  collection  of  PPL  This  is  representative  of  the 
larger  issue  of  the  tradeoflfbetween  the  cost  of  collecting,  maintaining,  and  disseminating  PPI 
and  the  benefits  received  in  terms  of  best  value. 

With  the  threshold  of  one  million  dollars,  or  even  five  hundred  thousand  dollars,  it 
seems  reasonable  that  some  nominal  amount  of  effort  expended  in  the  source  selection 
process  for  competively  negotiated  procurements  would  be  less  costly  than  oversight  and 
inspection  after  award.  The  problem  is  that  one  of  the  goals  of  policy  implementation  is  to 
include  past  performance  in  negotiated  procurements  down  to  the  one  hundred  thousand 
dollar  level.  Closely  associated  with  that  issue  is  the  requirement  that  all  contract  actions 
over  one  hundred  thousand  doUars  be  evaluated.  The  one  hundred  thousand  dollar  threshold 
and  the  recommendation  that  negotiated  procurements  under  that  value  should  use  PPI 
greatly  increases  the  costs  associated  with  what  is  now  an  amorphous  system.  Potentially 
adding  to  the  resource  problem  of  implementation  without  direction  is  the  pending  language 
of  the  DFARS  that  attempted  to  move  up  the  one  hundred  thousand  dollar  milestones  for 
preparing  evaluations  and  utilizing  PPI  by  one  year  and  eighteen  months  respectively.  [Ref. 
12]  A  logical  argument  to  the  wasted  resources  contention  is  that  through  trial  and  error,  a 
system  that  allows  contracting  officers  easy  access  to  PPI  would  result.  This  new  system, 
according  to  the  non-specific  vision  of  OFPP,  would  simply  require  solicitations  to  ask 
offerors  to  provide  a  list  of  past  contracts  that  they  have  performed  on.  This  list  would  be 
screened  against  the  system  and  all  applicable  evaluations  would  be  produced.  The  need  for 
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source  selection  boards  to  conduct  extensive  investigations/pre-award  surveys  and  interviews 
may  be  eliminated  or  substantially  reduced.  [Ref.  3:p.  8-9]  In  general  it  seems  that  the 
unarticulated  approach  that  is  bdng  taken  is  to  expend  resources  now  in  an  effort  to  produce 
a  series  of  solutions  that  could  be  chosen  from  to  produce  the  desired  system.  As  a  practical 
matter,  it  seems  likely  that  organizations  would  be  hesitant  to  commit  short  term  resources 
for  a  long-term  ambiguous  goal. 

3.  Rebuttals 

Assuming  that  a  system  of  evaluating  past  performance  could  be  implemented  by 
Government  sources,  the  issue  turns  to  one  of  accuracy  and  fairness  to  the  contractor  being 
evaluated.  Although  it  is  incumbent  upon  contracting  professionals  to  include  accurate  and 
unbiased  information  in  an  evaluation,  it  is  understood  that  human  nature  does  not  completely 
lend  itself  to  objective  behavior.  Emotions,  misunderstandings,  clerical  errors,  and  political 
pressures  could  play  a  part  in  both  the  fair  assessment  of  a  contractor’s  past  performance  and 
the  appropriate  application  of  the  evaluation.  A  mechanism  is  required  to  allow  a  contractor 
to  question  or  validate  the  information  presented. 

The  FAR  provides  that  once  the  inputs  are  received  and  an  evaluation  is  produced, 
both  must  be  provided  to  the  contractor  in  question  for  review  or  rebuttal.  The  contractor 
is  allowed  a  minimum  of  thirty  days  to  submit  any  remarks.  If  disagreement  exists  between 
the  contracting  officer  and  the  contractor,  and  it  cannot  be  resolved  to  either  party’s 
satisfaction,  the  issue  must  be  reviewed  one  level  above  the  contracting  officer.  Although  the 
ultimate  conclusion  of  performance  evaluation  will  rest  Avith  the  agency,  all  review  comments, 
contractor  responses,  and  the  evaluation  itself  must  be  included  in  the  evaluation  package. 
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[Ref.  1 :  Subpart  42. 1503]  Again,  the  issues  of  uniformity  and  resource  application  are  raised 
as  the  rebuttal  process  would  necessarily  involve  comparisons,  and  potentially  protests,  of 
different  evaluation  formats,  and  the  human  labor  required  to  facilitate  such  actions. 
Considering  the  number  of  sources  of  PPI  available,  and  the  requirement  that  each  evaluation 
be  provided  to  the  contractor  for  rebuttal,  the  overall  evaluation  process  could  be  stymied. 
Even  if  the  process  is  ultimately  streamlined  so  that  “one  stop  shopping”  for  PPI  is  available, 
the  thirty  day  minimum  requirement  for  rebuttals  could  produce  gaps  of  questionable 
in^ances  of  past  performance  that  would  have  been  considered  by  source  selection  officials. 
Contractors  could  intentionally  stretch  out  the  process  to  afford  themselves  an  opportunity 
to  successfully  compete  on  another  contract  where  the  same  “piece”  of  past  performance 
would  be  heavily  weighted.  The  tradeoff  is  fairness  to  the  contractor  versus  process  time. 

4.  Information  Age 

The  basic  issue  is  one  of  information  pertinence  and  fairness.  Given  the  frequency  of 
corporate  reorganizations,  mergers,  and  acquisitions:  should  information  obtained  about  an 
entity  that  performed  poorly  or  superbly  ten  years  ago  be  considered  pertinent  to  the  current 
acquisition?  The  situation  that  produced  an  incidence  of  poor  performance  ten  years  ago  is 
likely  to  be  much  different  than  one  that  exists  today.  Personnel  turnover,  equipment 
modernization,  process  maturation,  and  regulatory  streamlining  could  have  produced  a  vastly 
different  environment  for  the  target  contractor  to  perform.  Information  of  such  an  age  could 
also  be  entirely  different  with  regard  to  format  and  validity  than  the  requirements  of  the 
current  solicitation,  as  controls  such  as  the  rebuttal  process  and  a  normative  application  of 
evaluation  standards  were  not  in  effect.  What  is  an  appropriate  limit  on  how  old  information 


22 


can  be?  The  FAR  provides  that  the  evaluation  and  comments  from  both  parties  will  be 
retained  for  future  source  selection  purposes  no  longer  than  three  years  after  contract 
completion.  [Ref  1 : Subpart  42. 1 503]  It  is  important  to  note  that  the  FAR  prescribes  how 
long  the  information  should  be  retained  hy  Government  sources  vice  a  limit  on  how  old 
information  can  actually  be.  In  effect,  source  selection  officials  are  not  restricted  from  using 
information  obtained  from  either  commercial  or  Government  sources  that  is  older  than  three 
years.  It  should  also  be  noted  that  the  current  FAR  prescription  is  not  consistent  with  the  six 
year  limit  imposed  by  OFPP  in  1992.  [Ref  2]  Whatever  the  limit,  it  is  conceivable  that  both 
contractors  and  source  selection  officials  would  prefer  to  provide  or  use  information  that  best 
suits  their  needs.  Information  beyond  the  three  year  limit  may  be  the  only  pertinent 
information  available.  A  contractor  would  want  older  information  to  be  used  if  a  favorable 
trend  had  been  established  on  older  contracts  but  only  a  single  instance  of  poor  performance 
exists  within  the  last  three  years. 

D.  AUTOMATED  DATA  PROCESSING  SYSTEMS 

In  order  to  achieve  the  benefits  of  sharing  past  performance  information  among 
contracting  activities  and  aid  in  the  streamlining  of  the  source  selection  process,  a  system  or 
systems  must  be  established  to  deal  with  the  enormous  amount  of  data  that  will  be  produced 
as  a  result  of  the  contractor  evaluation  requirement.  Automating  the  storage  and  retrieval  of 
PPI  in  order  to  conduct  a  comparative  analysis  seems  to  be  necessary.  The  “vision” 
expressed  by  OFPP  implies  a  single  system  capable  of  producing,  rather  effortlessly,  a 
summation  of  performance  history  based  on  the  contractor’s  list  of  references  and  contract 
numbers.  [Ref  3:p.  8]  Such  a  system  does  not  seem  possible  without  some  automated  data 
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processing  features.  Users  of  PPI  currently  have  a  variety  of  automated  information  sources 
available,  Avhich  are  discussed  more  fully  in  Chapter  III.  The  systems  offer  a  wide  range  of 
features  under  the  umbrella  classification  of  a  past  performance  information  system  (PPIS). 

Whether  the  information  is  collected  and  stored  locally,  at  a  centralized  data  base,  or  a 
combination  of  both,  the  systems  used  to  track,  store,  and  disseminate  PPI  will  be  subject  to 
the  problems  of  differing  formats,  hardware  and  software  incompatibility,  user  friendliness, 
validity  of  data,  and  the  parochialism  or  “rice  bowl”  effect. 

1.  Format 

As  previously  mentioned,  the  format  of  the  evaluation  is  an  important  consideration 
when  establishing  an  automated  data  base.  It  is  not  the  issue  of  being  able  to  “map”  a 
particular  section  on  one  form  to  a  different  location  on  another,  but  rather  an  issue  of 
definition.  Once  assigned  by  the  programmer,  data  fields  can  easily  be  transferred  from  one 
data  base  to  another,  but  the  premise  behind  what  the  data  mean  to  the  evaluator  could  be  lost 
or  misinterpreted.  This  problem  is  exacerbated  if  the  number  and  type  of  grading  areas  or 
scoring  criteria  are  different.  The  whole  issue  could  be  negated,  however,  if  a  variety  of 
standard  formats  tailored  to  program  complexity,  commodity,  or  similar  criterion  was 
recommended.  Conceivably  multiple  formats  could  be  used  and  transmitted  precisely  as  they 
appeared  to  the  evaluator.  An  electronic  document  exchange  vice  a  data  base  field  exchange 
could  be  more  beneficial.  Although  the  complexity  of  this  proposition  is  currently  the  subject 
of  much  debate  under  the  larger  umbrella  of  Electronic  Commerce/Electronic  Data 
Interchange  (EC/EDI),  it  could  prove  to  be  a  compromise  between  the  tailored  and  prescribed 
approaches. 
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Another  option  is  to  continue  with  the  decentralized  systems  that  exist  today.  The 
Navy  would  maintain  its  RedAfellow/Green  (RYG)  and  Product  Deficiency  Reporting  and 
Evaluation  (PDREP)  Programs,  the  Air  Force  would  maintain  its  Contractor  Performance 
Assessment  Reporting  System  (CPARS),  and  the  Defense  Logistics  Agency  (DLA)  would 
continue  with  its  Automated  Best  Value  Model  (ABVM)  ^stem.  [Ref  6:p.  4]  Although  there 
are  many  common  features  to  each  system,  it  may  be  acceptable  to  simply  continue  with 
multiple  sources  of  information, 

2.  Compatibility 

This  compatibility  issue  essentially  involves  the  ability  of  the  respective  computers  to 
“talk“  to  each  other  effectively.  This  assumes  that  there  would  be  a  need  for  this  to  occur 
given  a  future  where  past  performance  continues  to  receive  its  current  level  of  attention. 
Pursuant  to  such  an  environment,  those  who  wish  to  comply  with  current  regulations  need 
to  choose  an  appropriate  method  that  would  maximize  compatibility  among  systems. 
Selecting  the  “right”  software  and  ensuring  that  adequate  personnel  are  trained  on  how  to 
utilize  and  configure  the  software  are  important  aspects  of  the  method.  Discerning  the 
current  software  trends  in  the  DOD  and  the  Federal  Government  are  also  important  so  as  not 
to  waste  resources  or  commit  to  a  direction  that  no  one  else  is  taking. 

One  of  the  most  prevalent  issues  concerning  compatibility  of  data  bases  is  the  use  of 
“open  architecture”  systems.  These  systems  facilitate  the  smooth  transfer  of  information 
from  one  data  base  to  another  regardless  of  the  software  used.  Further,  establishing  an 
“intuitive  desktop  tool  designed  for  decision  makers  to  access  vital  information  needed  from 
multiple  data  bases”  seems  to  fit  the  current  environment  of  multiple  PPIS.  [Ref  16] 
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Existing  systems  such  as  ABVM  and  PDREP  are  either  using  or  upgrading  to  ORACLE  data 
bases  and  a  UNIX  operating  system.  Although  minor  technical  problems  must  be  addressed, 
these  systems  should  be  able  to  readily  share  PPL  [Ref  17]  This  process  is  in  compliance  with 
the  limited  FAR  guidance  that  requires  that  information  can,  and  shall  be,  shared  between 
agencies  and  departments  when  requested  to  support  future  award  decisions.  [Ref  1 :  Subpart 
42.1503] 

3.  Validity  of  Data  Bases 

Although  the  issue  of  data  base  validity  has  been  alluded  to  previously,  it  is  relevant 
when  one  is  talking  about  machines  handling  and  interpreting  information.  Are  adequate 
safeguards  in  place  to  ensure  that  all  data  entered  into  the  data  bases  have  been  reviewed  and 
rebutted?  Is  supporting  documentation  available  within  the  system  to  substantiate  the  ratings 
given  to  a  particular  contractor?  These  issues  and  the  very  basic  one  of  whether  the  data 
entered  into  the  system  were  accurate  in  the  first  place  might  tend  to  create  apprehensions 
among  users.  Although  the  FAR  gives  general  guidance  with  regard  to  ensuring  the  proper 
review  and  rebuttal  of  evaluations,  it  does  not  address  how  to  specifically  deal  with  the 
multitude  of  evaluations  that  will  be  produced  and  stored  within  automated  systems.  [Ref 
1 : Subpart  42. 1503]  It  is  reasonable  to  assume  that  problems  could  arise. 

The  administrators  of  the  PDREP/RYG  systems,  the  Navy  Material  Quality 
Assessment  OfiBce  (NMQAO),  have  indicated  that  validity  is  a  serious  issue  at  this  time. 
Before  attempting  to  share  data  with  the  ABVM  system,  they  conducted  validity  checks  of 
randomly  selected  vendor  profiles.  Data  verification  letters  were  sent  to  the  commands  and 
vendors  indicated  in  the  ABVM  data  base  as  originating  the  evaluation.  It  was  determined 
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that  nearly  twenty  percent  of  the  records  selected  contained  inaccurate  information.  Whether 
it  was  erroneous  delivery  dates  or  different  assessments  of  quality,  the  data  were  in  error. 
The  Pr>RF.P  data  base  on  the  other  hand  experienced  fewer  problems  in  this  area.  Of  the  ten 
percait  of  evaluations  that  have  been  historically  challenged,  only  one  half  of  one  percent  ever 
require  alteration.  [Ref  17]  There  are  potential  flaws  despite  this  validation  system. 

Interpretation  of  what  is  to  be  considered  a  defective  vice  an  acceptable  lot  has  raised 
some  criticism  of  the  PDREP  system  by  one  of  its  users  at  PNSY.  The  Nuclear  Procurement 
Quality  Control  Office  has  questioned  the  appropriate  use  of  the  defective  lot  concept.  A 
pipe  which  received  damage  due  to  mishandling  in  transit  may  in  fact  only  have  a  slight 
imperfection  at  one  end  while  the  significant  remainder  is  fit  for  use.  The  user  and  the 
inspector  would  simply  remove  the  imperfection,  use  the  rest  of  the  pipe,  and  consider  the 
lot  to  be  acceptable.  But  due  to  the  relative  inflexibility  of  the  RYG/PDREP  system  and  its 
recognition  of  lots  versus  units  per  lot  would  record  the  lot  in  question  as  defective  in  the 
respective  vendor’s  profile.  [Ref  18] 

4.  Parochialism 

It  seems  likely  that  in  the  absence  of  a  clear  policy  with  regard  to  establishing  a  single 
or  compatible  systems,  that  there  would  be  independent  directions  followed  and  independent 
agendas  formed.  The  recent  popularity  of  the  past  performance  issue  gives  rise  to  competing 
technologies  and  ideologies  among  Government  organizations,  much  the  same  as  profit 
making  opportunities  gives  rise  to  private  sector  competitors.  Further,  public  sector 
organizations  need  to  create  something  distinctive  and  unique  about  their  organization  or  risk 
having  their  function  privatized.  [Ref  19;p.  78]  These  pressures  combined  with  the  genuine 
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desire  to  improve,  innovate,  and  create  motivate  many  of  the  players  involved  with  the  PPIS 
issue.  Traditional  inter-service  rivalry  is  also  a  fector  when  one  addresses  the  issues  of  system 
commonality  and  redundancy.  If  a  comprehensive  policy  delineating  the  establishment  of  a 
single  system  or  multiple  systems  working  in  concert  is  ever  realized,  “rice  bowls”  will  be 
affected.  Which  system  will  be  adopted  as  the  standard?  Which  system  or  systems  will  be 
deemed  redundant  given  a  common  evaluation  format?  To  what  degree  could  the  systems  be 
privatized?  These  questions  do  not  have  simple  answers.  It  is  the  researcher’s  opinion  that 
the  PDREP/RYG  and  ABVM  systems  are  potential  competitors  for  the  selection  of  a  single 
system,  given  their  similarities,  and  lead  to  the  discussion  of  the  centralized  versus 
decentralized  issue. 

5.  Centralized  versus  Decentralized 

In  addition  to  the  issues  addressed  under  the  format  categories,  the  centralized  versus 
decentralized  argument  essentially  revolves  around  the  control  consideration.  Should  PPIS 
be  controlled  by  a  singular  regulatory  or  management  body?  Given  the  incredible  diversity 
of  procurements  and  acquisitions  that  the  Federal  Government  and  DOD  engages  in,  it  is 
unlikely  that  all  of  the  concerns  and  requirements  of  each  agency  could  be  fairly  addressed  by 
one  body. 

E.  REFERENCES 

Another  primary  source  of  past  performance  information  is  references  from  other 
Federal  Government  agencies,  state  and  local  agencies,  and  commercial  entities.  Contractors 
can  be  required  to  submit  a  list  of  references  from  organizations  for  whom  they  have  provided 
a  similar  product  or  service.  In  addition,  contractors  can  provide  information  regarding  any 
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problems  encountered  on  the  identified  contracts  and  the  corrective  action  taken.  [Ref. 
1: Subpart  15.608]  General  considerations  of  the  discretionary  guidance  recommend 
soliciting  references  early  in  the  proposal  evaluation  process  fi'om  a  reasonable  number  of 
sources  (at  least  two),  with  the  preferred  method  being  by  phone.  A  well  organized  and 
effident  questionnaire  should  be  prepared  and  sent  in  advance  to  the  interviewee.  [Ref.  3;p. 
27-30]  Although  it  sounds  simple  to  request  and  receive  a  reasonable  number  of  references 
from  a  contractor  and  conduct  the  interviews,  receive  the  inputs,  and  make  the  assessment 
as  to  how  well  they  performed,  a  variety  of  issues  should  be  addressed  prior  to  incorporating 
references  into  the  source  selection  process.  The  problems  of  “cherry  picking,”  information 
age,  optimal  method,  Government  vs.  commercial,  format,  and  rebuttals  are  just  a  few. 

1.  “Cherry  Picking” 

The  “chmy  picking”  issue  relates  to  the  practice  of  contractors  selecting  only  those 
contracts  that  they  know  would  be  considered  favorably  by  the  Government.  This  practice 
would  distort  the  evaluation  process  and  could  potentially  displace  a  more  qualified  offeror. 
Although  the  solicitation  could  specifically  state  that  all  contracts  of  a  similar  nature  are  to 
be  listed,  the  contractor  could  genuinely  exclude  contracts  from  the  list  because  of  a 
difference  of  interpretation.  A  check  on  the  credibility  of  the  contractor  could  be  obtained 
through  the  use  of  PPIS  reports  listing  all  the  contracts  that  have  been  performed  by  the 
contractor  within  the  same  Federal  Supply  Class  (FSC).  This  process  could  also  be  subject 
to  gaps  in  time  pending  full  compliance  with  the  evaluation  preparation  requirements. 
Another  method  of  checking  the  contractual  history  of  a  contractor  could  involve  accessing 
the  Performance  Management  Reporting  System  (PMRS),  managed  by  the  Naval  Supply 
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Systems  Command  (NAVSUP),  or  the  Mechanization  of  Contract  Administrative  Services 
(MOCAS)  managed  by  the  Defense  Logistics  Agency  (DLA).  Both  systems  accumulate  a 
tremendous  amount  of  descriptive  contract  information.  [Ref  17]  In  the  end  however,  it  will 
likely  be  an  act  of  trust  that  dictates  the  value  placed  on  the  references  received. 

2.  Information  Age 

While  the  limit  on  retaining  past  performance  evaluations  is  three  years,  the  limit  on 
maintaining  references  is  not  specifically  addressed.  If  a  reference  is  not  incorporated  into  a 
PPIS,  then  there  is  no  reason  to  limit  the  solicitation  of,  or  retention  of,  reference  information 
to  any  length  of  time.  [Ref  1:  Subpart  42]  This  could  lead  to  problems  with  regard  to  trends 
versus  isolated  incidents  of  poor  or  superior  past  performance.  Source  selection  officials 
could  specify  the  maximum  age  of  contracts  for  which  references  are  being  sought,  but  this 
may  lead  to  the  exclusion  of  the  only  past  performance  information  available  from  a 
contractor.  This  would  make  the  contractor  appear  to  have  no  past  performance  in  the 
targeted  area  and  creates  the  other  problem  of  comparing  those  with  and  without  experience. 
The  discretion  of  the  contracting  officer  would  have  to  be  appHed  in  this  case. 

3.  Optimal  Method 

There  are  a  variety  of  methods  by  which  a  past  performance  reference  can  be 
obtained.  Once  the  appropriate  list  of  references  is  obtained,  a  questionnaire  could  be  faxed, 
mailed,  or  E-mailed  to  the  source,  or  interviews  could  be  conducted  either  face-to-face  or 
over  the  phone.  Of  these  methods,  telephone  interviews  are  probably  the  most  cost  effective 
and  practical.  One  reason  for  this  is  that  regardless  of  how  the  questionnaire  is  originally  sent 
to  the  source,  a  phone  interview  is  often  required  to  clarify  comments.  This  is  especially  true 
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if  a  particular  reference  was  a  significant  departure  fi'om  the  others.  [Ref  3  :p.  28-29]  It  is 
also  reasonable  to  assume  that  the  person  completing  the  reference  would  be  more  thorough 
if  being  questioned  vice  simply  pushing  an  additional  piece  of  paper  around  a  busy  desk. 

One  of  the  main  reasons  why  the  method  is  an  issue  is  that  resources  must  be  used 
to  solicit,  receive,  interpret,  and  apply  the  references.  Further,  unless  the 
references/evaluations  are  solicited  at  the  time  of  contract  completion  and  placed  into  a  PPIS, 
the  source  selection  official  runs  the  risk  of  getting  invalid  or  ambiguous  information  as 
memories  and  employee  turnovers  degrade  the  quality  of  the  reference.  If  the  use  of  reference 
information  is  to  help  streamline  the  process,  then  it  should  be  considered  for  some  sort  of 
automation. 

4.  Format 

Once  again  the  issue  of  format  is  raised  as  a  possible  impediment  to  efficiently 
collecting  PPL  Using  a  standardized  reference  format  would  achieve  the  same  benefits  that 
a  standardized  evaluation  form  would,  and  would  likewise  decrease  the  flexibility  that  may 
be  required  for  the  “instant”  contract.  Using  a  standard  format  would  also  facilitate  the 
reference’s  inclusion  into  a  data  base  along  with  standard  evaluations.  This  gives  the  future 
users  of  the  PPI  a  larger  pool  of  information  to  choose  from  and  to  analyze. 

5.  Commercial  versus  Government  References 

One  of  the  primary  concerns  with  accepting  commercial  evaluations  is  the  fact  that 
the  source  of  the  reference  and  the  target  of  the  reference  could  have  been  engaged  in  a 
buyer/seller  relationship.  That  relationship  may  still  exist  and  any  derogatory  information 
that  could  somehow  be  attributed  to  the  commercial  buyer,  could  adversely  affect  future 
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dealings.  Another  aspect  of  this  is  that  due  to  the  complicated  nature  of  primary  contractors 
(primes)  and  subcontractors  (subs)  in  major  systems  procurements,  a  prime  who  contributes 
a  reference  that  is  highly  critical  of  a  former  “sub”  could  be  doing  so  to  cast  a  shadow  on  the 
sub’s  performance,  in  order  to  win  a  competition  in  which  they  may  be  actively  engaged. 
Source  selection  officials  should  be  able  to  surmise  such  relationships  and  give  credence  as 
appropriate. 

6.  Rebuttals 

As  mentioned  in  the  introduction  to  this  section,  contractors  are  to  be  provided  an 
opportunity  to  submit  amplifying  information  along  with  their  list  of  references.  They  are  not 
however,  technically  afforded  the  right  to  dispute  the  reference  once  submitted.  Unless  the 
reference  is  provided  by  a  Government  agency,  vice  a  commercial  source,  and  could  be 
described  as  an  evaluation,  it  would  not  necessarily  receive  the  same  review  process.  A  check 
to  this  is  that  if  the  information  were  to  be  placed  into  a  PPIS,  it  would  be  exposed  to  the 
rebuttal  process.  (Assuming  the  proposed  DFARS  language  is  adopted)  [Ref  12]  This  issue 
could  also  be  resolved  if  the  solicitation  clearly  established  a  review  process  for  all  PPL  [Ref 
3;p.  22] 

F.  SOLICITATION  AND  SOURCE  SELECTION 

As  is  the  case  with  any  factor  or  scoring  methodology  used  in  the  source  selection 
process,  the  use  of  past  performance  must  be  clearly  delineated  in  the  solicitation  and  then 
applied  as  described.  Additionally,  the  factors  and  subfactors  must  be  tailored  to  each 
acquisition  and  must  have  an  impact  on  the  source  selection  decision.  [Ref  1  :Subpart  15.605] 
The  key  to  the  use  of  past  performance  is  the  establishment  of  a  clear  relationship  between 
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the  statement  of  work  (SOW)  in  Section  L  of  the  solicitation,  and  the  evaluation  criteria  in 
Section  M.  These  sections  should  also  be  clear  Avith  regard  to  what  PPI  will  be  evaluated  and 
how  it  will  be  weighted.  [Ref  3;p.  19]  In  general,  the  contracting  activity  needs  to  be  as 
explicit  as  possible  about  what  information  is  required  and  how  past  performance  will  be 
evaluated  in  order  to  be  fair  to  all  offerors  and  to  avoid  protests.  A  case  in  point  is  a  protest 
that  the  Comptroller  General  sustained  after  it  was  determined  that  the  source  selection 
oflBcials  unreasonably  selected  one  offeror  over  another  based  on  flawed  past  performance 
measurement  and  comparison.  Specifically,  they  determined  that  the  Defense  Reutilization 
and  Marketing  Service  (DRMS)  imposed  a  forty  nine  percent  price  premium  on  the 
unsuccessful  ofieror  due  to  a  lack  of  experience.  This  premium  was  deemed  to  be  excessive 
based  on  the  articulated  past  performance  evaluation  criteria.  [Ref  20] 

Another  major  issue  that  would  force  source  selection  officials  to  take  great  care  in 
crafting  the  solicitation  is  the  “new  entrant”  treatment.  Essentially  this  involves  the  evaluation 
of  contractors  who  have  no  relevant  past  performance.  The  FAR  simply  indicates  that 
offerors  with  no  past  performance  information  will  be  given  a  neutral  evaluation  in  that 
category.  [Ref  1: Subpart  15.608]  This  is  vague  considering  the  different  methods  of  scoring 
or  rating  proposals.  OFPP  offered  a  method  that  involved  creating  an  average  of  all  other 
ofierors  who  do  have  documented  past  performance,  and  applying  that  average  to  the  offeror 
in  question.  [Ref  3]  Is  this  fair  to  the  contractor  who  has  no  past  performance  but  who  might 
have  superior  technical  and  cost  proposals?  Another  aspect  of  fairness  is  that  of  the  offerors 
who  fell  below  the  average.  The  “new  entrant”  obtained  an  advantage  over  them  without 
having  any  past  performance  evaluation.  Another  method  of  dealing  with  this  issue  is  to 


33 


eliminate  past  peiforaiance  as  a  fector  from  the  applicable  contractor.  The  average  of  all  the 
other  factors  would  then  be  used  to  calculate  an  overall  evaluation  grade.  This  could  lead  to 
problems  if  colors  or  adjectives  were  used  as  they  cannot  easily  be  manipulated  like  numerical 
scores.  Even  numerical  methods  could  cause  problems  if  the  overall  assessment  was  based 
on  a  total  point  scheme.  It  can  be  seen  from  these  examples  that  the  “new  entrant”  problem 
is  difficult  to  address  in  the  solicitation,  and  is  probably  more  difficult  to  support  during  the 
source  selection. 

Specific  guidance  on  how  to  compose  the  necessary  language  in  the  solicitation  is 
provided  via  a  variety  of  sources.  The  OFPP  Best  Practices  Guide  [Ref  3],  incorporates 
several  samples  of  Section  L  and  M  remarks,  and  the  Navy  Acquisition  Reform  Turbo 
Streamliner  Web  site  [Ref  21]  lists  a  variety  of  actual  examples  of  the  language  that  have 
proven  successful. 

G.  CONCLUSION 

The  variety  of  issues  listed  in  this  chapter  illustrates  the  many  potential  problems  that 
could  negatively  impact  the  successful  implementation  of  the  past  performance  policy.  In 
general,  the  researcher  feels  that  more  direction  is  needed  with  regard  to  the  overall  vision  of 
past  performance  policy.  Prescriptions  to  the  degree  contained  in  the  proposed  DFARS 
language  do  not  provide  such  direction  and  may  actually  contribute  to  the  contentiousness 
of  the  issue. 
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m.  TOOLS 


A.  INTRODUCTION 

The  regulatory,  statutory,  and  best  practices  guidance  discussed  thus  far  are  essentially 
intangible  means  to  achieve  the  positive  ends  purported  by  the  past  performance  “movement”. 
When  it  comes  down  to  preparing  the  evaluations  and  utilizing  all  the  past  performance 
information  available  however,  physical  systems  or  programs  need  to  be  in  place,  or 
developed,  to  aid  in  the  practical  application  of  the  guidance.  There  are  currently  several 
such  programs/systems  that  are  available  to  help  contracting  officials  collect,  archive, 
distribute,  and  utilize  past  performance  information.  In  addition  to  the  commodity  type 
tracking  systems  mentioned  in  Chapter  11,  R/Y/G  and  ABVM,  there  are  also  systems  that 
provide  appraisal  information,  contract  administration  information,  and  quality  certifications. 
Depending  on  how  one  defines  a  PPIS,  there  are  at  least  thirty  five  systems  currently  in  use 
throughout  the  DOD.  Not  all  of  these  systems  will  have  an  application  to  PNSY  but  are 
listed  for  the  reader  in  Appendix  B.  [Ref  6:p.  A-2]  The  purpose  of  this  chapter  is  to  identify 
and  briefly  describe  the  variety  of  past  performance  information  systems  that  currently  exist. 
The  primary  focus  will  be  on  those  systems  that  have  the  most  relevance  to  PNSY;  and  these 
will  be  described  in  more  detail.  Additionally,  future  PPIS  are  listed  as  they  appear  to  be 
promising . 

B.  PRODUCT  DEFICIENCY  REPORTING  AND  EVALUATION  PROGRAM 

The  Product  Deficiency  Reporting  and  Evaluation  Program  (PDREP)  is  a  Navy-wide 
automated  system  that  which  tracks  the  product/material  quality  of  items  provided  by  the 
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supplying  contractor.  [Ref.  22]  Managed  by  the  Navy  Material  Quality  Assessment  Office 
(NMQAO)  in  Portsmouth  NH,  PDREP  is  intended  to  provide  a  more  effective  use  of  quality 
assurance  and  delivery  information  by  combining  source  data  from  all  Navy  System 
Commanders  (SYSCOMS)  into  a  single  system.  Additionally,  it  is  intended  to  improve  the 
reliability  and  maintainability  of  purchased  material,  thereby  assisting  Navy  personnel  in 
making  a  more  objective  award  decision/determination.  [Ref  23]  Users  may  access  PDREP 
products  via  software  applications,  installed  on  their  personal  computers  or  office  servers,  and 
a  modem  link  to  NMQAO. 

1.  Reports  (The  “Product”) 

The  PDREP  system  contains  relevant  contractor  evaluation  data,  deficiency  reports 
on  new  and  reworked  material,  and  general  contract  information  for  Naval  material.  The 
system  also  contains  information  about  Government  owned  products  under  development. 
Government  lot  acceptance  tests,  rework  assessment  tests,  test  products,  and  Government 
furnished  equipment.  [Ref  23  :p.  1-3]  In  general,  the  reports  can  be  classified  into  three  types; 
ad-hoc,  pre-formatted/canned,  and  graphical  representations.  [Ref  23  :p.  1-9]  This  feature, 
combined  with  the  variety  of  qualifiers/parameters  by  which  data  may  be  extracted,  provides 
flexibility  to  the  user  and  permits  a  tailored  approach  to  PPI  gathering.  The  specific  types 
of  PPI  that  can  be  extracted  from  PDREP  include  [Ref.  22]; 

•  Summary  profile  of  Contractor  Past  Performance  by  Commercial  and  Government 
Entity  (CAGE)  Code.  Parameters  include  date  ranges  and  Federal  Supply  Class 
(FSC) 

•  Defect  rate  by  National  Stock  Number  (NSN).  Parameters  include  date  ranges, 
rejected  attributes,  contractor  name,  and  contract  number 
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•  Defect  rate  by  specification.  Parameters  include  sorting  by  NSN,  contractor  name, 
contract  number,  and  date  range 

•  Detailed  descriptions  of  deficiencies  reported  by  Navy  users.  Parameters  include 
sorting  by  part  number,  NSN,  CAGE,  date  range,  end  item  type,  and  Equipment 
Identification  Code  (EIC) 

•  Lists  of  Approved  Engineering  Alternatives  for  Level  I,  Sub-safe  materials 

•  Alternate  Sources  of  Supply/Diminishing  Manufacturing  Sources.  Parameters 
include  a  listing  of  manufacturers  who  have  previous  experience  producing  similar 
items,  and  summary  listings  of  contractor  and  ESC  past  performance  ratings  used 
in  the  R/Y/G  Program 

•  Cross  reference  lists  between  contractor  name/location  and  CAGE  code. 
Parameters  include  phone  numbers  and  mailing  addresses 

•  Listing  of  suspended  or  debarred  contractors 

•  Contractor  survey  information  by  CAGE  code  which  provides  a  summairy  listing 
of  deficient  areas 


2.  Sources  of  Information 

The  PDREP  system  collects,  maintains,  and  distributes  data  collected  fi'om 
commands  within  each  of  the  SYSCOMS.  Source  documents/inputs  include  Material 
Inspection  Records  (MIR),  Quality  Deficiency  Reports  (QDR),  Contractor  Surveys 
(preaward,  product,  special).  Test  Reports,  Special  Quality  Data,  and  Waivers/Deviations. 
[Ref  23  ;p.  1-8]  Additional  inputs  are  provided  in  the  form  of  Contract  Delivery  Data, 
Government-Industry  Data  Exchange  Program  (GIDEP)  information,  CAGE  updates. 
Corrective  Action  Requests,  and  Bulletins.  [Ref  6]  All  of  the  aforementioned  source 
documents  are  required  to  be  validated,  via  contractor  challenge,  by  the  submitting 
command.  Contractors  are  also  afforded  an  opportunity  to  challenge  their  overall 
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classifications  within  the  system  as  summary  listings  are  provided  to  them  regularly.  The 
following  statistics  provide  an  indication  of  the  breadth  and  depth  of  information  contained 
within  PDREP  [Ref  6]: 

•  7500  electronic  reports  received  on  average  each  month 

•  750  hard  copy  reports  received  on  average  each  month 

•  700,000  CAGE  records  on  file 

•  1 1,000  active  contractor  files 

•  541  FSCs  represented 

•  50,000  Product  Quality  Deficiency  Reports  (PQDRs) 

•  400,000  MIRs 

•  32,000  R/Y/G  classifications 

•  2,000  classification  changes  per  month 

It  should  be  noted  that  the  PDREP  data  base  continues  to  expand  as  more  and  more 
commands  submit  data.  Such  contributions  are  necessary  to  prevent  a  cycle  of 
disappointment  and  non-participation  as  users  try  to  obtain  information  about  a  specific 
contractor  via  PDREP,  only  to  find  out  that  the  target  contractor  is  not  yet  listed.  Also  as 
mentioned  in  the  previous  chapter,  the  possible  combination  or  sharing  of  data  between  the 
PDREP  and  ABVM  data  bases  would  greatly  increase  the  number  of  contractor  records 
available.  [Ref  17]  The  use  of  a  distributed  data  base  system,  such  as  the  Open  Architecture 
Retrieval  System  (OARS)  and  the  Oracle  7  data  base  could  also  provide  for  information 
sharing  among  any  number  of  existing  and  future  data  bases.  [Ref  24] 
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c. 


REDA^LLOW/GREEN 


The  R/Y/G  Program  is  a  performance  tracking  system  established  to  help  reduce  the 
risk  of  receiving  nonconforming  products  and  late  shipments.  [Ref  25]  Primarily  designed  for 
purchases  below  the  Simplified  Acquisition  Threshold  (SAT)  of  one  hundred  thousand 
dollars,  R/Y/G  utilizes  the  PDREP  electronic  data  base  that  assigns  a  color  performance  risk 
classification  to  represented  contractors.  It  assists  buyers  in  making  best  value,  low  risk 
awards  vice  “low  cost”,  high  risk  awards,  and  utihzes  the  following  designations:  red 
represents  high  performance  risk,  yellow  is  moderate  risk,  and  green  is  low  risk.  There  is  also 
a  neutral  category  for  those  contractors  who  do  not  have  a  record  of  past  performance  within 
the  requested  FSC.  Utilizing  software  resident  within  the  PDREP  package,  buyers  query  the 
system  for  classifications  on  a  particular  contractor  within  an  FSC.  These  classifications, 
which  are  updated  continuously  and  downloaded  monthly,  are  presented  to  the  buyer  via 
tailorable  reports.  Two  methodologies  are  currently  employed  by  the  system  to  utilize  these 
classifications  in  making  best  value  decisions:  the  Technical  Evaluation  Adjustment  (TEA) 
and  the  Greatest  Value/Best  Buy.  [Ref  25] 

1.  Technical  Evaluation  Adjustment 

In  addition  to  the  color  classifications,  the  system  provides  a  relatively  simple 
mechanism  for  comparing  proposals  or  offers  by  assigning  a  price  adjustment  factor,  the 
TEA,  to  account  for  any  oversight  costs  to  the  Goverrunent.  This  oversight  would  be 
necessary  to  reduce  the  risk  of  receiving  non-conforming  products  or  late  deliveries  and  is 
based  on  the  contractor’s  past  performance.  Once  the  price  adjustment  factor  is  determined, 
it  is  applied  to  a  Red  or  Yellow  offeror’s  price  in  an  effort  to  provide  a  more  realistic  estimate 
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of  the  true  cost  to  the  Government.  This  may  have  the  effect  of  displacing  the  low  cost 
offeror  behind  one  with  a  higher  price.  [Ref  6:p.  17] 

2.  Greatest  Value/Best  Buy 

This  method  is  used  primarily  in  large  purchases  where  the  differences  in  the  offerors’ 
prices  may  render  the  TEAs  ineffective.  [Ref  25]  It  is  essentially  a  means  by  which  the  color 
classification  is  used  in  conjunction  with  cost/price  or  other  source  selection  factors  as  an 
additional  discriminator;  that  is,  performance  risk.  At  a  minimum  it  could  be  used  as  a  “flag” 
to  detect  potential  performance  risk  problems  that  would  require  further  investigation. 

3.  Applicability 

The  PNSY  Contracting  Division  currently  uses  the  WY/G  system  in  its  Small 
Purchases  Branch.  [Ref  7]  All  Navy  Field  Contracting  Activities  (NFC A)  are  required  to 
check  the  R/Y/G  system  for  classifications  on  each  offeror.  This  information,  if  available, 
must  then  be  used  to  evaluate  past  performance.  [Ref  26]  Although  PNSY  Contracting 
Division  is  not  currently  considered  an  NFCA,  it  did  formerly  fall  under  the  Naval  Supply 
Systems  Command  (NAVSUP)  claimancy  for  contracting  functions.  This  may  account  for 
their  inclusion  of  the  RJY/G  system  in  their  standard  operating  procedures.  [Ref  27]  [Ref 
7]  Currently  the  contracting  organization  at  PNSY  falls  within  the  Naval  Sea  Systems 
Command  (NAVSEA)  who  does  not  require  the  use  of  RA^/G  specifically. 

D.  AUTOMATED  BEST  VALUE  MODEL  (ABVM) 

ABVM  is  a  Defense  Lo^stics  Agency  (DLA)  system  that  provides  buyers  with  a  best 
value  procurement  technique  similar  to  that  of  the  RAT/G  system.  It  covers  specific 
equipment  and  supplies  by  FSC  or  other  specification,  and  reports  on  the  quality  and  delivery 


40 


performance  of  the  vendor.  [Ref  22]  ABVM  analyzes  an  offeror’s  historical  quality  and 
delivery  performance  over  a  specified  time  period,  and  translates  that  performance  into  a 
numerical  score  that  can  be  considered  along  with  price.  [Ref  28]  Buyers  can  then  make  a 
trade-off  decision  between  the  offeror  with  the  lowest  price  and  the  offeror  with  a  higher 

price  and  a  better  past  performance  score. 

ABVM  is  a  module  of  the  DLA  Pre- Award  Contracting  System  (DPACS)  that  is  used 
at  DLA  centers  to  automate  the  solicitation  and  award  processes.  DPACS  is  also  a  migration 
system,  along  with  MOCAS,  to  the  Standard  Procurement  System  (SPS)  which  is  currently 
being  tested  throughout  DOD.  [Ref  29] 

ABVM’s  applicability  to  PNSY  will  most  likely  be  realized  via  its  shared  data  with 
the  PDREP  and  RAT/G  systems.  Although  no  formal  plans  seem  to  be  in  place  to  somehow 
merge  the  two  data  bases  [Ref  30],  it  is  reasonable  to  expect  some  form  of  compatible  system 
given  their  similarities.  The  similar  nature  of  the  past  performance  information  being  stored, 
and  the  comparison  methodologies  employed  from  these  systems  should  permit  an  expansion 
of  the  overall  data  base  resource.  ABVM  will  also  be  converting  to  an  Oracle  7  data  base 
that  will  aid  in  the  compatibility  and  ease  of  use  areas. 

E.  COMMERCIAL  SERVICES 

Although  not  specifically  addressed  in  the  current  guidance,  commercial  services  are 
available  to  provide  PPI  on  prospective  awardees.  Dunn  &  Bradstreet  Inc.  offers  a  Supplier 
Performance  Review  that  provides  an  assessment  of  how  well  a  company  performs  as  a 
supplier,  based  on  the  solicited  evaluations  or  references  from  former  customers.  The  ratings 
provided  are  broken  down  into  eight  categories;  overall  rating,  timeliness,  problem 
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responsiveness,  quality,  total  cost,  technical  support,  delivery  quantities,  and  supplier  attitude. 
The  scoring  or  rating  method  used  is  on  a  5.0  performance  scale  where  a  five  indicates  that 
a  supplier  does  not  meet  performance  expectations  and  a  one  indicates  that  the  supplier 
exceeded  expectations.  These  ratings  are  presented  both  numerically  and  graphically  by 
category.  A  comparison  is  also  provided  between  the  vendor’s  individual  score  and  an 
average  of  all  vendors  in  the  same  Standard  Industrial  Classification  (SIC).  Finally  an 
individual  listing  of  how  each  customer  rated  the  vendor  is  provided  "with  their  applicable  SIC. 
[Ref  31] 

This  service  could  have  great  application  to  organizations  that  do  not  have  the  volume 
of  competitively  negotiated  procurements  that  could  justify  establishing  a  formal  system  of 
contractor  past  performance  evaluation.  It  could  also  be  utilized  as  an  added  source  of  PPI 
or  as  a  validation  of  information  already  received  from  Government  sources.  The  cost  of  the 
service  is  based  on  the  extent  of  information  required  and  could  be  weighed  against  the 
internal  labor  costs  that  would  be  required  to  obtain  the  information  by  other  means.  The 
FAR  does  not  specifically  address  the  issue  of  using  commercial  data  bases  but  users  should 
understand  that  the  validity  of  the  PPI  in  this  or  any  system  should  be  considered  prior  to 
use. 

F.  GOVERNMENT  INDUSTRY  DATA  EXCHANGE  PROGRAM 

The  Government-Industry  Data  Exchange  Program  (GIDEP)  is  an  interactive 
electronic  network  used  for  the  collection,  storage,  retrieval,  and  exchange  of  product 
technical  data.  As  the  name  implies  it  involves  inputs  from  and  outputs  to  both  Government 
and  industry.  Users  generally  incorporate  the  information  into  the  research,  design. 
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development,  production,  operation,  and  quality  assurance  aspects  of  equipment  or  systems. 
The  overall  purpose  of  this  Government  funded  system  is  to  realize  cost  savings  and  improve 
quality  and  reliability  of  complex  systems  and  equipment.  [Ref  32] 

The  types  of  information  that  can  be  extracted  include:  engineering  data,  failure 
experience,  metrology,  reliability/maintainability,  product  information,  and  urgent  data 
requests.  The  engineering  data  contains  a  variety  of  information  but  the  most  applicable  to 
the  past  performance  concept  are  the  quality  assessments  and  the  evaluation  and  qualification 
test  reports.  The  system  also  contains  information  on  failure  rates,  replacement  rates, 
demonstration  tests,  and  prediction  reports.  [Ref  32] 

The  main  application  of  this  system  at  PNSY  is  either  the  PDREP  system,  which 
receives  inputs  from  GIDEP,  or  through  direct  access  by  procurement  quality  control 
personnel  or  engineers.  Since  many  of  the  procurements  at  PNSY  involve  quality  assurance 
issues,  as  it  is  a  nuclear  submarine  repair  facility,  GIDEP  could  provide  another  means  of 
obtaining  quality  information  on  a  particular  vendor. 

G.  LOCAL  TOOLS 

Although  not  necessarily  developed  for  the  express  purpose  of  serving  as  a  PPI,  there 
are  several  “systems”  in  place  at  PNSY  that  could  provide  past  performance  data.  These 
systems,  also  addressed  in  the  next  chapter,  are  legitimate  sources  of  information  and  should 
be  recognized  as  tools  in  the  same  sense  as  formal  PPIS.  Contract  Completion  Records  are 
filled  out  by  both  the  customer  and  the  buyer  and  are  placed  in  the  contract  file  for  future 
reference.  The  records  include  a  general  assessment  of  the  overall  quality  and  delivery 
performance  of  a  contractor  for  a  given  contract.  The  rating  criteria  for  the  assessment 
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involve  a  simple  yes  or  no  answer  to  a  quality  and  delivery  satisfaction  question.  There  is 
also  a  small  area  for  general  remarks  that  could  include  additional  details.  [Ref  33]  It  should 
be  noted  that  contract  files  in  general  can  provide  significant  past  performance  data  in  cases 
where  PNSY  has  contracted  with  the  target  offeror  in  the  past.  This  source  seems  to  be  taken 
for  granted  in  the  current  guidance. 

Contracting  Officer’s  Technical  Representative  (COTR)  reports  are  produced  annually 
and  contain  textual  descriptions  of  contractor  performance  on  a  given  contract.  [Ref  34] 
This  report  is  more  of  a  first  hand  assessment  of  how  the  contractor  is  doing  while 
performance  is  ongoing  vice  completed.  Quality  is  addressed  as  are  specific  elements  of 
contract  conformance  and  schedule  adherence.  [Ref  35] 

Data  bases  are  also  being  maintained  by  several  organizations  within  PNSY.  The 
Material  Management  System  (MMS)  is  the  shipyard’s  system  for  tracking  material 
requirements  against  specific  work  orders,  equipment,  shops,  boats,  etc.  Included  in  the  data 
base  is  the  background  or  “boiler  plate”  information  concerning  materials  procured  fi-om 
particular  contractors.  Material  receipt  inspection  information  is  also  included  and  can  be 
accessed  by  buyers,  contracting  officers,  or  procurement  quality  control  specialists  (both 
nuclear  and  non-nuclear).  [Ref  3 6] [Ref  7] 

Other  local  sources  of  PPI  include  the  data  bases  and  vendor  files  maintained 
individually  by  the  nuclear  and  non-nuclear  procurement  quality  control  personnel.  Whether 
automated  or  manual,  information  such  as  Material  Inspection  Records  (MIR),  Quality 
Deficiency  Reports  (QDR),  vendor  lists,  testing  results,  contractor  alert  lists,  and  suspended 
or  debarred  lists,  is  stored  and  used  in  the  technical  referral  process.  [Ref  1 8] 
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H.  CONTRACTOR  PERFORMANCE  ASSESSMENT  REPORTING  SYSTEM 


The  Contractor  Performance  Assessment  Reporting  System  (CPARS)  is  an  Air  Force 
system  that  tracks  contractor  past  performance  for  major  acquisition  programs  above  five 
million  dollars.  [Ref  22]  The  system  uses  qualitative  and  quantitative  measures  in  an  effort 
to  compare  what  the  contractor  promised  to  what  was  actually  delivered.  [Ref  37]  It  is  a 
manual  system  kept  in  files  at  Air  Force  Product  Centers,  and  was  designed  for  a  low  volume 
of  transactions  with  extensive  performance  measurement  categories.  [Ref  22] 

Each  report  includes  a  description  of  the  program,  a  statement  describing  the 
contractor’s  eflFort,  a  narrative  describing  the  contractor’s  performance,  and  a  color  rating  for 
each  evaluation  category/area.  Some  of  the  categories  include:  product/system  performance, 
schedule  adherence,  cost  performance,  product  assurance,  test  and  evaluation,  the  ILS 
program,  management  responsiveness,  and  subcontract  management.  The  color  ratings 
consist  of  red,  yellow,  green,  and  blue.  [Ref  22]  In  addition  to  the  detailed  narratives  and 
summary  classifications,  a  summary  statement  fi'om  the  program  manager  is  required  at  the 
end  of  every  report  and  should  read  as  follows  [Ref  37]: 

Given  what  I  know  today  about  the  contractor’s  ability  to  execute  what  he 
promised  in  his  proposal  I  (definitely  would  not,  probably  would  not,  might 
or  might  not,  probably  would  or  definitely  would)  award  to  him  today  given 
that  I  had  a  choice. 

This  is  a  powerful  statement  for  a  contracting  officer  to  place  into  an  evaluation.  It  essentially 
gives  a  subjective  synopsis  of  the  impression  left  with  the  contracting  officer.  Although  the 
CPARS  system  does  not  generally  apply  to  contracting  activities  such  as  PNSY,  it  is  being 
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expanded  to  small  systems,  services,  science  and  technology,  and  operational  contracting. 
Steps  are  also  being  taken  to  automate  the  information  processes. 

L  FUTURE  SYSTEMS 

Given  the  attention  currently  being  paid  to  the  past  performance  issue,  it  is  not 
surprising  that  a  variety  of  new  systems  are  being  developed  to  conform  with  current  policy 
and  to  provide  more  eflBcient  means  of  utilizing  PPI.  The  following  are  a  few  of  the  systems 
that  appear  to  have  promise: 

•  Contractor  Past  Performance  Rating  System  (Army  Material  Command) 

•  Vendor  Rating  System  (Air  Force  Material  Command) 

•  Automated  Past  Performance  System  (US  Army  Contracting  Support  Agency) 

•  Contractor  Information  Service  (Defense  Logistics  Agency) 

•  Contractor  Profile  System  (Defense  Logistics  Agency) 

•  Standard  Procurement  System  (DOD) 
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CHAPTER  IV.  THE  ENVIRONMENT 


A.  INTRODUCTION 

Implementing  the  Federal  Government’s  past  paformance  policies  requires  an  analysis 
of  not  only  the  general  issues  surrounding  the  policies  and  the  tools  available,  but  of  the 
particular  environment  in  which  the  PNSY  Contracting  Division  operates.  The  environment 
includes  the  contracting  business  areas,  organizational  relationships,  and  resources.  This 
chq)ter  analyzes  the  major  issues  and  systems  discussed  in  Chapters  n  and  III  in  the  context 
of  PNSY’ s  environment. 

B.  CONTRACTING  BUSINESS 

The  Portsmouth  Naval  Shipyard’s  primary  business  is  repairing  the  fleet’s  nuclear 
attack  submarines.  PNSY  is  one  of  the  most  modem  shipyards  available  to  the  US.  Navy  and 
operates  a  state  of  the  art  drydocking  facility.  Repairs  can  be  effected  via  overhauls  and 
availabilities  at  the  shipyard,  or  via  “fly  away”  crews  that  travel  to  submarine  home  ports  such 
as  Norfolk,  VA  and  San  Diego,  CA.  The  mission  of  PNSY  is  to: 

Provide  quality  overhaul,  refueling,  modernization,  and  repair  of  nuclear 
submarines  and  related  products  and  services  in  a  safe,  timely,  and  cost 
effective  manner. 

In  support  of  this  mission,  the  Contracting  Division  provides  purchasing  and  contracting 
services  for  the  Shipyard.  Although  the  Shipyard  is  the  primary  customer,  the  Contracting 
Division  provides  support  for  a  multitude  of  customers  including;  submarines  at  the  shipyard, 
repair  shops,  the  Supply  Department,  the  Naval  Medical  Clinic,  the  Defense  Marketing  and 
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Reutilization  Office  (DRMO),  NISE  West,  NISE  East,  SUBMEPP,  NAVSEA,  SPCC,  and 
SPAWAR. 

Given  the  number  of  different  customers,  the  Contracting  Division  has  gained 
procurement  experience  in  a  broad  spectrum  of  supplies  and  services.  Experience  ranges 
from  marine  equipment,  construction  materials,  and  fiber  optic  components  to  social  services, 
lodging,  and  education  and  training  services.  (Appendix  C  provides  a  more  complete  listing) 
This  diversity  has  an  impact  on  the  types  of  past  performance  information  that  will  be  utilized 
in  the  source  selection  process,  and  the  types  that  will  be  evaluated  on  a  recurring  basis.  Also 
impacting  PNSY’s  utihzation  of  PPI  and  evaluation  of  past  performance  is  the  volume  of 
contract  actions  in  general,  and  the  number  of  competitively  negotiated  procurements 
specifically. 

1.  Contracting  Business  Profile 

Fiscal  years  (FY)  1995  and  1996  contract  completion  data  were  used  to  analyze  the 
volume  of  contract  actions  that  could  require  an  evaluation  to  be  produced  in  future  years, 
and  also  to  determine  the  number  of  competitively  negotiated  procurements  that  could  use 
past  performance  as  a  source  selection  factor.  The  source  of  the  data  was  the  summary  listing 
of  Individual  Contracting  Action  Reports  (DD  Form  350).  The  DD  Form  350  is  required 
to  be  completed  after  every  contract  action,  including  Dehvery  Orders  (DO),  Task  Orders 
(TO),  and  Modifications  (Mods).  Tables  1  and  2  below  summarize  the  data  for  FY  1995  and 
1996  respectively: 
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Contact  Action  Category 

Volume 

%  Cat. 

%  Total 

Total  Contract  Actions  (Inch  mods,  DOs,TOs) 

355 

100 

100 

Greater  than  $1,000,000 

10 

3 

3 

Greater  than  $500,000 

29 

8 

8 

Greater  than  $100,000 

161 

45 

45 

Less  than  $100,000 

194 

55 

55 

Total  Modifications,  Delivery/Task  Orders 

283 

80 

80 

Total  New  Contract  Actions 

72 

20 

20 

Greater  than  $1,000,000 

2 

3 

.5 

Greater  than  $500,000 

6 

8 

1.6 

Greater  than  $100,000 

23 

31 

6.5 

*Utilizing  Competitive  Negotiation 

12 

52 

3.4 

Less  than  $100,000 

49 

68 

14 

Total  Simplified  Acquisitions 

6,545 

N/A 

N/A 

Table  1.  Contract  Action  Data  for  Fiscal  Year  1995. 

The  column  heading  “%  Cat.”  indicates  the  percentage  that  the  contract  action 
category  represents  within  the  larger  category  above  it.  For  example,  new  contract  actions 
represent  20%  of  the  total  number  of  contract  actions  performed,  while  competitively 
negotiated  contract  actions  represent  52%  of  new  contract  actions  greater  than  $100,000. 
The  simplified  acquisitions  category  is  provided  for  comparative  purposes  and  represents 
approximately  95%  of  all  purchasing  and  contract  action  volume  for  both  years.  As  a  percent 
of  total  obligations,  simplified  acquisitions  represent  approximately  18%  of  purchasing  and 
contract  action  volume. 
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Contract  Action  Category 

Volume 

%  Cat. 

%  Total 

Total  Contract  Actions  (Incl.  mods,  DOs,  Tos) 

431 

100 

100 

Greater  than  $1,000,000 

14 

3 

3 

Greater  than  $500,000 

42 

10 

10 

Greater  than  $100,000 

208 

48 

48 

Less  than  $100,000 

223 

52 

52 

Total  Modifications,  Delivery/Task  Orders 

355 

82 

82 

Total  New  Contract  Actions 

76 

18 

18 

Greater  than  $  1 ,000,000 

0 

0 

0 

Greater  than  $500,000 

3 

4 

.7 

Greater  than  $  1 00,000 

30 

40 

7 

*  Utilizing  Competitive  Negotiation 

14 

47 

3 

Less  than  $100,000 

46 

53 

11 

Total  Simplified  Acquisitions 

6862 

N/A 

N/A 

Figure  2.  Contract  Action  Data  for  Fiscal  Year  1996. 

In  general,  the  data  reveal  that  new  contract  actions  make  up  a  very  small  percentage 
of  the  total  actions  reported  in  FY  1995  and  1996  (20%  and  18%  respectively).  The  vast 
majority  of  contract  actions,  vice  simplified  acquisitions,  is  comprised  of  modifications, 
delivery  orders,  and  task  orders.  Naturally  all  of  these  actions  are  based  on  the  award  of  an 
original  contract,  but  the  use  of  multiple  year  contracts/options  does  not  require  the  issuance 
of  a  new  contract  for  the  required  product  or  service  each  year.  This  directly  impacts  the 
number  of  past  performance  evaluations  that  must  be  prepared.  The  other  significant  feature 
of  the  data  is  the  small  number  of  competitively  negotiated  procurements.  This  impacts  the 


50 


requirement  to  utilize  PPI  in  the  source  selection  process.  A  review  of  the  dollar  threshold 
and  milestone  requirements  of  the  FAR  applicable  to  the  two  issues  is  provided  in  Table  3 
below: 


Contract  Value 

Prepare  Evaluation 

Utilize  in  S/S 

>  $1,000,000 

1  July  1995 

1  July  1995 

>  500,000 

1  July  1996 

1  July  1997 

>  100,000 

1  Jan.  1998 

1  Jan.  1999 

Table  3.  Evaluation  Preparation  and  Utilization  Requirements 

2.  Evaluation  Preparation 

If  the  average  number  of  new  contracts  in  the  last  two  years  is  an  indication  of  the 
total  number  of  contract  actions  that  would  need  to  be  evaluated  in  the  future,  then 
conforming  to  the  regulation  seems  to  be  a  fairly  small  task.  Currently,  PNSY  Contracting 
Division  would  need  to  ensure  that  evaluations  were  prepared  for  “each  contract”  over 
$500,000  (Ref  1 :  Subpart  42.1502].  The  number  of  new  contracts  at  this  threshold  averages 
just  4.5  per  year.  At  the  $100,000  threshold,  it  would  average  nearly  27  per  year.  Neither 
of  these  statistics  would  seem  to  cause  much  of  a  personnel  drain.  Even  if  evaluations  were 
required  for  new  contracts  below  $100,000,  the  number  required  would  still  only  average  48 
per  year.  The  problem  with  this  assessment  however,  is  one  of  terminology  interpretation. 
If  “each  contract”  is  alternatively  interpreted  to  mean  each  new  contract,  each  modified 
contract,  each  delivery  order,  and  each  task  order  which  meets  the  threshold,  then  the  task 
of  preparing  evaluations  would  grow  enormously.  The  complication  of  determining  whether 
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to  evaluate  the  original  contract,  the  DO/TO  alone,  or  a  combination  also  adds  to  the 
confusion.  It  seems  reasonable  to  assume  that  the  FAR  language  would  apply  to  DOs/TOs 
in  that  specific  products  or  services  are  being  delivered  just  as  they  would  for  a  new  contract 
action.  An  interpretation  of  the  FAR  requirement  to  produce  interim  evaluations  for  contracts 
exceeding  one  year  may  also  give  weight  to  the  DO/TO  argument.  [Ref  1 : Subpart  42. 1502] 
A  final  consideration  is  that  Contracting  Officer’s  Representatives  (CORs)  are  sometimes 
required  to  prepare  evaluations  for  DOs/TOs.  These  could  be  used  to  satisfy  the  requirement 
of  evaluation  preparation  provided  that  they  contain  adequate  past  performance  measures 
(cost,  quality,  timeliness,  etc.). 

Complicating  the  evaluation  preparation  process,  regardless  of  the  volume,  is  the  fact 
that  the  responsibility  to  prepare  them  is  distributed  among  those  who  could  actually  provide 
meaningful  input.  The  contracting  officer  who  solicited  the  contract  could  be  responsible 
overall,  with  “subordinate”  players  from  technical  offices,  receipt  and  inspection  branches, 
testing  centers,  and  end  user  organizations.  In  order  to  obtain  an  accurate  assessment  of  how 
well  the  contractor  performed  on  a  given  contract,  the  inputs  of  all  these  participants  in  the 
process  should  be  obtained.  Obstacles  to  making  this  an  easy  process  include  the  physical 
separation  of  functions,  incompatibility  of  existing  procedures,  workload  prioritization,  and 
overall  cognizance.  In  any  case,  human  resources  from  the  “technical  office,  contracting 
office,  and  where  appropriate,  end  users”,  are  required  to  prepare  the  evaluations.  [Ref 
1 ;  Subpart  42. 1502]  The  interaction  that  would  be  required  among  these  parties  is  another 
element  that  is  directly  influenced  by  the  volume  of  contracts  requiring  evaluations.  A  system 
needs  to  be  established  that  could  effectively  and  efficiently  “hand  off’  the  evaluation 
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document  between  the  parties;  or  one  that  incorporates  separate  inputs  electronically  or 
manually.  Additionally,  and  perhaps  most  fundamentally,  PNSY  needs  to  adopt  an  evaluation 
format.  A  manual  or  electronic  form  needs  to  be  established  in  order  to  conform  with  the 
mandatory  guidance.  Considering  the  variety  of  commodities  and  services  that  the 
Contracting  Division  procures,  a  single  prescription  may  not  be  appropriate.  Basic  issues 
such  as  quality,  cost,  and  timeliness  seem  to  be  accepted  throughout  Government,  and  should 
be  evaluated,  but  customer  service,  and  business  relations  may  be  too  difficult  to  obtain  or  too 
subjective  to  include  in  all  evaluations. 

Regardless  of  how  many  evaluations  need  to  be  prepared,  an  opportunity  for 
contractor  review  and  rebuttal  must  be  established.  The  evaluations  could  be  mailed  to  each 
contractor,  reviewed,  rebutted,  and  then  mailed  back  where  they  would  be  reviewed  by  the 
contracting  officer.  If  the  information  is  contested  and  cannot  be  resolved  by  the  contracting 
officer,  then  the  matter  must  be  reviewed  at  one  level  higher  than  the  contracting  officer. 
Complicating  the  process  is  the  fact  that  contractors  have  a  minimum  of  thirty  days  to  review 
and  challenge  the  information.  If  the  volume  of  contracts  requiring  evaluations  is  dependent 
on  DOs  and  TOs,  the  preparation,  mail,  review,  and  final  determination  processes  could 
create  intolerable  delays.  A  bulletin  board  system,  similar  to  the  method  employed  by 
ABVM,  could  be  established  in  order  to  facilitate  the  evaluation  process.  Currently  PNSY 
does  not  have  a  bulletin  board  system  for  this  or  other  purposes,  nor  does  it  have  a  Web  site. 

Another  issue  closely  associated  with  evaluation  preparation,  and  also  reference 
solicitation,  is  the  sensitivity  of  information.  Since  evaluations  and  references  are  to  be  used 
in  the  source  selection  process,  all  such  information  should  be  marked  “Source  Selection 
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Information”  and  should  not  be  disclosed  to  anyone  other  than  the  respective  contractor  and 
Government  source  selection  officials  who  request  it.  [Ref  l:Subpart  42.1503]  If  a  bulletin 
board  or  Web  site  method  is  used  to  facilitate  the  review  process,  “fire  walls”  or  other 
controlled  access  measure  must  be  taken. 

Information  age  is  not  a  significant  issue  at  PNSY  currently  as  evaluations  have  not 
heretofore  been  prepared,  nor  has  reference  information  been  solicited  as  defined  by  the 
current  guidance.  [Ref  7] 

The  tailored  versus  prescriptive  evaluation  issue  seems  to  directly  impact  PNSY. 
Given  the  diversity  of  contract  actions  that  are  likely  to  be  encountered,  a  single  evaluation 
format  could  limit  the  effectiveness  of  the  evaluation.  If  the  evaluations  will  ultimately  be 
consolidated  into  a  system  which  requires  a  numerical  vice  an  adjectival  rating  system,  or  one 
which  contains  six  instead  of  four  rating  areas,  then  PNS  Y’s  format  may  have  to  be  changed. 
Such  a  situation  is  entirely  likely  given  the  volatile  nature  of  current  policy  formulation.  An 
example  of  this  volatility  is  the  proposed  DFARS  language,  that  prescribed  an  adjectival 
scoring  system  and  four  rating  areas,  and  was  suspended  pending  further  review. 

3.  Utilization  in  the  Source  Selection  Process 

The  data  reveal  that  there  are  relatively  few  competitively  negotiated  procurements 
over  the  $100,000  level  (on  average  only  thirteen  per  year).  Source  selection  officials  would 
therefore,  be  required  to  use  past  performance  in  the  source  selection  process  at  the  rate  of 
approximately  one  per  month  if  the  business  climate  remains  the  same.  This  also  assumes 
that  past  performance  would  be  an  appropriate  factor  in  the  particular  contracting  situation 
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and  that  the  contracting  officer  would  not  seek  a  waiver.  The  basic  actions  required  for  each 
source  selection  would  include  the  following: 

•  Document  the  use  of  past  performance  in  the  RFP.  (Section  L/M) 

•  Solicit  a  list  of  references  from  all  offerors.  (Gov’t,  Commercial,  State/Local) 

•  Screen  local  files  and  data  bases  for  pertinent  PPL 

•  Screen  off-site  data  bases  for  pertinent  PPL  (PDREP,  Dunn  &  Bradstreet) 

•  Conduct  reference  checks.  (Phone  interview,  mail.  E-mail,  fax,  etc.) 

•  Provide  all  PPI  to  contractors  for  review/rebuttal.  (Assuming  no  previous 
challenge) 

•  Receive,  validate,  collate,  and  compare  PPI  for  each  contractor. 

•  Compare  and  evaluate  offerors  using  all  factors. 

The  actions  listed  would  have  to  be  performed  in  a  timely  manner  by  the  source 
selection  official  or  board.  The  complexity  of  the  procurement,  the  personnel  available,  PPI 
access,  the  rebuttal  process,  and  the  sundry  of  issues  relating  to  references  could  inhibit  the 
process. 

a.  Procurement  Complexity 

PNS  Y  contracts  for  a  variety  of  supplies  and  services  as  indicated  in  Appendix 
C.  The  case  of  American  Management  Systems  Inc.  (AMS)  is  especially  indicative  of  the 
complexity  of  procurements  in  which  PNSY  is  involved.  This  contractual  relationship  is 
worth  nearly  thirty  million  dollars  and  involves  dozens  of  management  service  task  orders  and 
modifications.  Further  complicating  the  issue  is  that  the  contracts  are  let  on  behalf  of 
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NAVSEA.  In  fact,  nine  out  of  the  ten  largest  contracts  that  PNSY  is  responsible  for,  are 
solicited  on  behalf  of  customers  outside  of  the  Shipyard.  This  is  contrasted  with  a  relatively 
simple  source  selection  process  to  procure  a  pump  or  a  motor.  It  may  be  relatively  easy  to 
obtain  pertinent  past  performance  data  for  the  supply  of  a  singular  piece  of  equipment,  but 
very  difficult  to  acquire  it  on  a  similar  service  for  each  of  the  disparate  services  provided 
under  the  AMS  contract.  Another  example  of  this  is  the  potential  need  to  buy  motors  from 
Louis  Allis  Corporation  versus  hotel  services  from  the  Radisson  Hotel  chain.  The  breadth  of 
potential  source  selection  opportunities  is  certainly  a  factor  in  utilizing  past  performance  in 
the  source  selection  process. 

The  complexity  issue  would  also  impact  the  solicitation  language,  describing 
how  past  performance  will  be  used,  and  the  evaluation  process  itself  The  more  complex  the 
procurement,  the  more  detailed  the  solicitation  language  and  evaluation  procedure  need  to 
be.  Multiple  deliverables,  schedules,  and  cost  elements  create  the  potential  for  confusion  and 
misinterpretation.  A  major  concern  for  PNSY  should  be  to  tailor  the  solicitation  language 
and  evaluation  procedures  to  the  particular  contract  to  ensure  completeness  and  relevancy. 

b.  Personnel  Resources 

The  bottom  line  with  implementing  any  policy  that  requires  performing  an 
action  previously  not  required,  is  personnel  resources.  Naturally  in  the  source  selection  case, 
the  officials  who  are  in  charge  of  the  overall  process  would  be  tasked  to  obtain  past 
performance  information  on  the  offerors.  This  is  not  necessarily  an  issue  provided  that  the 
iirformation  is  “readily”  obtainable. 
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Obtaining  a  list  of  references  from  the  contractor  is  relatively  simple  and 
should  be  requested  in  the  solicitation/RFP.  Actually  interviewing  the  reference  or  otherwise 
obtaining  the  evaluation  information  requires  considerable  personnel  resources.  As  mentioned 
under  the  evaluation  preparation  section  above,  the  rebuttal  process  could  also  consume 
considerable  personnel  and  time  resources. 

Screening  and  interpreting  data  from  a  PPIS  such  as  PDREP  would  also 
involve  personnel  resources,  although  not  to  the  degree  that  a  manual  effort  would  entail. 
Provided  that  the  target  contractors  are  represented  within  the  PDREP  system,  and  given  the 
close  proximity  of  the  system  to  PNSY,  this  seems  to  be  a  logical  choice  for  obtaining  past 
performance  information. 

c.  Information  Access 

The  process  of  obtaining  PPI  could  potentially  slow  the  process  to  the  point 
where  the  benefits  are  lost.  The  hst  of  actions  that  could  be  taken  to  secure  PPI  all  involve 
discreet  functions  and  processes  that  consume  time  and  resources.  The  responsiveness  of 
systems,  reference  organizations,  and  offerors  contributes  to  the  delay  and  can  also  present 
additional  barriers.  Organizations  may  become  deluged  with  requests  for  PPI  on  contractors 
with  whom  they  have  done  business.  Information  systems  may  contain  only  limited 
information  about  the  contractor  which  leads  to  false  impressions. 

Potentially  PNSY  could  access  the  information  from  any  or  all  of  the  methods 
described  earlier.  They  are  currently  set  up  to  receive  PPI  from  the  PDREP  and  WY/G 
systems,  but  technology  and  policy  changes  may  produce  a  “clearing  house”  type  system 
which  would  incorporate  inputs  from  a  variety  of  compatible  systems. 
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Soliciting  reference  information  from  the  offerors,  and  evaluation  information 
from  the  references  would  require  the  development  of  letter  and  telephone  interview 
templates  that  could  quickly  generate  the  required  information. 

Using  references  from  commercial  entities  should  also  be  considered  to 
provide  offerors  with  an  opportunity  to  present  relevant  PPI  even  if  they  are  a  new  entrant 
in  the  Government  contracting  arena.  This  makes  sense,  given  the  Government  goals  of 
fairness  and  competition,  and  may  also  preclude  a  protest. 

New  entrants  should  be  a  concern  to  PNSY  source  selection  officials. 
Adequate  procedures  should  be  established  to  deal  with  the  “neutral”  evaluation  of  offerors 
with  no  past  performance  history.  The  OFPP  approach  of  equating  a  new  entrant’s  past 
performance  grade  to  an  average  of  all  offerors  could  be  applied  to  PNSY  provided  that  a 
numerical  scoring  system  is  used.  Trying  to  average  colors  or  adjectives  is  more  ambiguous 
than  numerical  averaging,  and  could  open  the  door  to  protests.  This  argument  lends 
credibility  to  the  use  of  evaluation  templates  which  overlay  the  three  main  scoring  systems; 
numerical,  adjectival,  and  color. 

Local  information  is  available  from  the  both  the  nuclear  and  non-nuclear 
procurement  quality  functions  at  PNSY,  but  would  need  a  more  systematic  method  of 
collection,  storage,  and  retrieval. 

4.  Miscellaneous  Issues 

The  remaining  issues  addressed  in  Chapter  11,  such  as  the  “cherry  picking”  concept, 
and  compatibility,  are  germane  to  PNSY  in  the  general  context.  They  must  be  addressed  as 
appropriate  during  the  course  of  policy  implementation  and  practice. 
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C.  ORGANIZATIONAL  ENVIRONMENT 


Elements  of  PNSY’s  organizational  environment  can  potentially  have  an  impact  on 
the  implementation  of  Federal  past  performance  policies.  Internally,  there  are  separate 
fiinctional  areas  which  utilize  past  performance  information  on  a  relatively  independent  basis. 
Externally,  the  PNSY  Contracting  Division  and  the  shipyard  in  general  have  experienced  a 
series  of  realignments  and  force  reductions.  These  factors,  combined  with  a  pending 
realignment  could  impact  the  way  PNSY  incorporates  past  performance  into  its  business 
operations. 

1.  Internal  Elements 

There  are  several  functional  areas  within  the  PNSY  organization  that  could  contribute 
to  a  past  performance  information  collection  process  or  utilize  the  information  to  make 
professional  decisions.  Specifically,  Material  Receipt  and  Inspection,  Nuclear  Procurement 
Quality  Control,  Procurement  Quality  Assurance,  and  Contracting  are  areas  that  could 
potentially  contribute  to  and  receive  the  benefits  fi'om  a  local  past  performance  information 
system. 

The  Material  Receipt  and  Inspection  functions  could  provide  delivery  and  product 
quality  data  on  a  continual  basis.  The  date  received  at  PNSY  and  a  general  assessment  of 
apparent  product  damage  or  fitness  for  use  is  made.  Much  of  this  information  is  currently 
reported  into  the  Material  Management  System  (MMS)  as  an  historical  record.  If  this  data 
could  be  extracted  in  a  useable  form  without  undue  delay,  the  evaluation  preparation  process 
would  be  greatly  enhanced. 

The  Nuclear  Procurement  Quality  Control  and  Quality  Assurance  functions  routinely 
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collect  detailed  quality  conformance  data.  Structured  programs  are  in  place  to  track 
deficiencies  and  screen  sub-standard  contractors.  The  Nuclear  Procurement  Quality  Control 
function  actually  has  an  automated  quality  tracking  system  that  was  developed  locally  and  is 
capable  of  extracting  data  fi'om  MMS.  If  this  system  could  be  used  to  incorporate  additional 
elements  of  contractor  past  performance  such  as  cost  and  customer  satisfaction,  it  could  be 
of  great  value  in  the  source  selection  process. 

A  system  which  would  integrate  the  information  from  all  of  the  functional  areas  could 
greatly  enhance  the  achievement  of  command  quality  and  efficiency  goals.  If  the  Contracting 
Division  had  access  to  the  quality  and  dehvery  information,  it  could  combine  it  with  cost, 
business  relations,  and  customer  service  data  to  assess  a  contractor’s  ability  to  perform  in  the 
future.  If  the  source  selection  process  ensures  awards  to  contractors  who  consistently 
provide  superior  products  and  services,  the  Quality  Control  and  Assurance  functions  will  be 
aided  in  achieving  their  goals  as  well.  An  integrated  system  has  the  potential  for  improving 
the  source  selection  and  quality  control  processes,  with  the  ultimate  goal  of  providing 
superior  products  to  the  customer. 

2.  External  Elements 

The  Portsmouth  Naval  Shipyard  is  currently  a  component  of  the  Naval  Sea  Systems 
Command  (NAVSEA).  The  Contracting  Division  is  likewise  an  element  of  NAVSEA,  and 
receives  its  contracting  authority  from  them.  [Ref  7]  This  organizational  relationship 
however,  is  a  relatively  recent  change  (1994).  Prior  to  NAVSEA  the  Contracting  Division 
reported  to  the  Naval  Supply  Systems  Command  (NAVSUP).  As  indicated  in  Chapter  m, 
this  accounts  for  the  Contracting  Division  following  a  mixture  of  NAVSEA  and  NAVSUP 
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giudance.  [Ref.  7]  This  becomes  more  of  an  issue  if  the  two  SYSCOMS  adopt  fundamentally 
different  past  performance  policies.  If  PNSY  makes  an  independent  decision  on  how  to 
implement  the  Federal  policies,  and  its  current  source  of  general  contracting  guidance  pursues 
a  direction  divergent  from  PNSY’s,  then  much  effort  could  be  wasted.  Although  unlikely, 
the  fluid  nature  of  the  past  performance  initiative  could  create  such  a  situation.  Complicating 
this  further  is  the  pending  realignment  of  PNSY  under  a  regional  maintenance  authority.  [Ref. 

7] 

The  consolidation  of  maintenance  and  repair  efforts  for  the  Northeast  Region  under 
the  Commander  in  Chief,  U.S.  Atlantic  Fleet  (CINCLANTFLT)  could  change  the  Contracting 
Division’s  reporting  relationship  once  again.  Although  this  possesses  the  potential  for  policy 
conflict,  it  could  also  present  an  opportunity  to  consolidate  past  performance  information 
from  activities  who  perform  similar  repair  and  maintenance  functions,  and  who  are  also 
located  in  fairly  close  proximity  to  each  other.  This  could  faci’itate  a  coordinated  effort  if  it 
was  determined  that  a  common  PPIS  would  be  beneficial. 
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V.  IMPLEMENTATION  PLAN 


A.  INTRODUCTION 

An  effective  implementation  plan  is  required  in  order  to  reap  the  benefits  of  the  past 
performance  initiative.  Benefits  such  as  streamlined  source  selection  procedures,  best  value 
procurements,  oversight  reduction,  and  increased  customer  satisfaction  can  be  realized  by 
PNSY  through  the  adoption  of  a  coherent  past  performance  policy. 

Preparing  evaluations  and  utilizing  PPI  in  the  source  selection  process  are  the  two 
primary  elements  of  the  policy  which  must  be  included  in  the  plan.  In  effect  there  are  two 
separate  plans  in  that  one  relates  to  preparing  the  evaluations  and  the  other  relates  to  utilizing 
PPI  in  the  source  selection  process.  These  processes  for  implementing  the  policies  must  also 
address  the  overriding  functional  issues  of  communication  and  training,  resource  allocation, 
standard  operating  procedures,  incentives,  flexibility,  compatibility,  simplicity,  and  follow-up 
procedures. 

This  chapter  provides  an  overall  plan  for  implementing  past  performance  policies  at 
PNSY.  In  order  to  allow  a  more  realistic  and  flexible  approach,  the  general  principles  of 
policy  implementation  via  stakeholder  involvement  are  utilized.  “Attention  to  stakeholder 
concerns  is  crucial;  the  key  to  success  ...is  the  satisfaction  of  key  stakeholders.”  [Ref 
19:p.27]  Although  specific  recommendations  based  on  the  author’s  research  are  provided 
within  this  framework,  it  is  not  wise  to  assume  that  all  issues  have  been  taken  into 
consideration  at  the  functional  and  local  levels.  These  critical  issues  of  the  day  to  day 
conformance  with  the  policies  can  be  identified  by  the  stakeholders. 
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B.  COMMUNICATION  AND  TRAINING 

It  is  important  that  all  affected  personnel  are  aware  of  the  past  performance  initiative. 
With  the  multitude  of  acquisition  streamlining  efforts  currently  underway,  it  is  a  significant 
task  to  keep  abreast  of  the  details  and  applicability  of  each.  Given  this  environment  and 
considering  daily  workloads,  it  is  unlikely  that  past  performance  would  receive  the 
preponderance  of  the  workforce’s  attention.  Therefore,  the  subject  of  past  performance 
policy  must  be  specifically  addressed  and  discussed  with  all  concerned.  Training  must  also 
be  conducted  at  several  different  levels.  From  the  basic  interpretation  of  what  is  immediately 
required  as  per  the  FAR,  to  the  larger  context  of  integrated  information  systems,  personnel 
must  be  made  aware  of  the  situation. 

1.  Identify  the  Stakeholders 

The  stakeholders  in  the  policy  implementation  process  need  to  be  identified  in  order 
to  present  a  coherent  implementation  plan.  A  stakeholder  can  be  defined  as  “any  person, 
group,  or  organization  that  can  place  a  claim  on  an  organization’s  attention,  resources,  or 
output  or  is  affected  by  that  output.”  [Ref  19;p.27]  A  stakeholder  for  the  purposes  of  this 
case,  is  any  organization  or  individual  who  would  be  required  to  take  significant  action  as  a 
result  of  the  policy  implementation.  Based  on  the  two  primary  features  of  the  Federal  policy, 
source  selection  officials  and  “evaluators”  are  the  main  groups.  The  source  selection  officials 
would  naturally  include  contracting  and  procurement  quality  personnel,  while  evaluators 
include  receipt  and  inspection  personnel,  quality  assurance  personnel,  contract  specialists,  and 
customers.  Although  the  applicable  functions  internal  to  PNSY  and  the  local  customers  are 
relatively  easy  to  identify,  external  customers  would  need  to  be  identified  via  an  historical 
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analysis  of  contract  actions  exceeding  the  thresholds.  Once  identified,  these  customers  should 
be  given  the  opportunity  to  participate  in  the  policy  implementation  process. 

2.  Introduce  the  Topic 

Rather  than  attempting  to  “force  feed”  the  Contracting  Division  and  other 
stakeholders  the  Federal  past  performance  policies,  the  issues  should  be  broadcast  via  an 
introductory  memorandum  fi'om  the  Contracting  Division  Officer.  Addressees  should  include 
all  purchasing  and  contracting  personnel,  as  well  as  procurement  quality  control  persoimel, 
receiving  and  inspection  personnel,  and  affected  customers.  This  preliminary  measure  should 
include  a  description  and  interpretation  of  the  current  Federal,  DOD,  and  Naval  guidance. 
“The  first  requirement  for  effective  implementation  is  that  those  responsible  for  carrying  out 
a  decision  must  know  what  they  are  supposed  to  do.”  [Ref.  38:p.295] 

The  basic  requirements  of  utilization  and  evaluation  preparation,  with  the  associated 
dollar  thresholds  and  milestones,  are  key  elements  of  the  guidance  and  should  be  detailed  first. 
Bulletized  descriptions  of  the  major  issues,  such  as  evaluation  format  and  validity,  should 
follow.  References  should  also  be  listed  in  the  memorandum  so  that  the  readers  can  make 
their  own  interpretation  of  the  guidance  if  desired. 

Another  key  element  of  the  memorandum  would  be  to  address  the  potential  benefits 
to  the  command  and  the  customer.  Preparing  past  performance  evaluations  should  be  equated 
with  providing  a  best  value  product  to  the  customer.  The  best  value  concept  is  implicit  in 
PNSY’s  mission,  given  the  emphasis  on  quality  and  safety,  and  should  strike  a  favorable 
chord  in  the  minds  of  all  involved.  This  should  have  the  effect  of  “incentivizing”  all  involved 
to  contribute  productively  to  the  process.  The  close  of  the  memorandum  should  include  an 
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avenue  for  submitting  suggestions,  criticisms,  or  general  comments  (E-mail,  suggestion  box, 
etc.)  in  anticipation  of  a  meeting  with  the  stakeholders. 

3.  Follow-up  Correspondence 

Based  on  the  results  of  any  feedback  from  the  memorandum  recipients,  and  on  the 
applicable  guidance,  a  draft  past  performance  evaluation  should  be  prepared  and  submitted 
to  the  appropriate  stakeholders.  Appendix  D  is  a  sample  format  prepared  by  the  researcher 
and  is  a  composite  of  several  formats  suggested  by  the  OFPP  Best  Practices  Guide,  the 
proposed  DFARS  language,  and  the  R/Y/G  program.  This  would  be  used  for  soliciting 
comments  before  and  during  a  proposed  meeting.  Similarly,  draft  solicitation  language  should 
be  sent  to  source  selection  officials  in  order  to  elicit  feedback.  An  example  of  this  is  provided 
via  Appendix  E,  and  is  also  a  composite  of  sample  language  suggested  by  OFPP  and  the  Navy 
Acquisition  Reform  Web  site. 

4.  Modifled  Working  Group 

A  modified  or  loosely  defined  working  group/team  should  be  established  in  order  to 
address  the  proposed  evaluation  format,  solicitation  language,  and  other  functional  issues. 
The  team  concept  is  preferred  because  one  person  cannot  have  all  the  qualitative  and 
quantitative  answers,  nor  can  one  person  grasp  and  satisfy  all  the  inter-functional  political 
agendas.  [Ref  19:p.219]  The  rationale  behind  establishing  an  informal  group  is  to  avoid 
creating  yet  another  process  action  team  with  the  associated  reporting  and  meeting 
requirements,  while  still  being  able  to  recognize  those  who  have  a  role  in  the  process  and  to 
create  an  atmosphere  for  focused  attention.  The  goals  of  the  group  should  be  to  provide 
adequate  training  and  to  reach  a  consensus  on  policy  implementation. 
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In  order  to  keep  the  past  performance  policy  issue  in  its  proper  perspective,  a  balance 
needs  to  be  achieved  with  regard  to  the  number  of  stakeholders  brought  together  to  address 
it.  Only  those  directly  affected  by  the  policy  requirements  should  comprise  a  working  group. 
Competing  priorities,  geographic  distance,  and  value  added  factors  should  be  considered 
before  attempting  to  physically  bring  all  stakeholders  together.  Once  considered,  a  “meeting” 
should  be  held.  With  the  goal  of  a  timely  consensus  in  mind,  the  meeting  could  actually  be 
series  of  conference  calls,  proxy  discussions,  or  correspondence.  In  any  case,  the  process 
should  not  be  complicated  nor  unnecessarily  lengthy. 

The  meetings  or  discussions  should  try  to  resolve  as  many  of  the  main  issues  as 
possible  given  the  time  and  personnel  contraints.  Short  of  accomplishing  this  goal,  the 
ultimate  decision  on  which  evaluation  or  utilization  method  to  use  will  fall  to  the  Contracting 
Division  Officer. 

5.  Technical  Training 

Li  addition  to  the  training  provided  via  the  correspondence  and  discussions,  formal 
technical  training  is  required  for  source  selection  personnel  on  the  use  of  automated  past 
performance  information  systems.  NMQAO  offers  training  on  the  use  of  its  PDREP  and 
R/Y/G  systems  and  is  located  in  close  proximity  to  PNSY.  Buyers,  contract  specialists, 
procurement  quality  personnel,  and  the  Contracting  Division  Officer  should  be  scheduled  to 
receive  the  training.  Formal  training  on  these  systems  would  likely  provide  a  much  more 
informed  view  of  the  capabilities  and  limitations  of  the  systems,  and  would  move  the 
organization  closer  to  achieving  process  efficiencies. 
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6.  Maintain  Lines  of  Communication 

Once  initiated,  the  communication  process  among  stakeholders  should  be  maintained 
to  facilitate  changes  and  enhancements  to  the  implementation  program.  Developing  plans  to 
integrate  local  information  systems  and  to  take  advantage  of  external  systems  would  also  be 
easier  once  familiar  lines  of  communication  are  established. 

C.  PAST  PERFORMANCE  INFORMATION  SYSTEM  UTILIZATION 

The  stakeholders  should  discuss  the  merits  of  using  available  past  performance 
information  systems.  As  a  practical  matter,  the  systems  available  to  PNSY  are  PDREP, 
RA^/G,  Dunn  &Bradstreet’s  service,  and  local  data  bases.  This  does  not  preclude  the 
adoption  of  new  systems  as  they  come  on  line  within  the  Navy  or  DOD  however. 

The  PDREP  and  R/Y/G  systems  should  be  utilized  to  the  maximum  extent  possible. 
These  programs  are  specifically  dedicated  to  Navy  users  and  are  “fed”  jfrom  commands  similar 
to  PNSY.  Once  training  is  received,  these  systems  can  be  a  significant  source  of  PPI  for 
buyers  and  source  selection  officials. 

A  local  system  should  be  developed  utilizing  the  quality,  delivery,  and  contract  data 
available  across  the  functional  areas  previously  addressed.  Representatives  from  the  nuclear 
and  non-nuclear  procurement  quality  functions,  material  receipt  and  inspection  functions,  and 
the  Contracting  Division  should  conduct  a  feasibility  analysis  of  their  individual  processes  to 
determine  the  best  method  of  integrating  and  utilizing  the  information  available. 

If  the  Regional  Maintenance  realignment  initiative  becomes  a  reality,  a  proposal  for 
the  establishment  of  a  unified  PPIS  should  be  prepared  by  the  Contracting  Division  Officer, 
and  distributed  among  the  members  of  the  new  coalition.  Feedback  should  then  be  solicited 
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from  all  involved  in  order  to  ascertain  the  feasibility  of  such  a  venture.  If  a  consensus  of 
opinion  is  reached  as  to  the  utility  of  a  regional  PPIS,  a  program  should  be  established  based 
on  the  details  of  the  consensus. 

D.  STANDARD  OPERATING  PROCEDURES 

Establishing  a  standard  operating  procedure  (SOP)  should  be  one  of  the  major  goals 
of  the  working  group.  The  Contracting  Division’s  SOPs  should  cover  the  two  primary  areas 
of  policy  implementation,  evaluation  preparation  and  information  utilization.  A  proposed 
SOP  is  provided  via  Appendix  F.  Although  any  procedures  prescribed  would  be  subject  to 
change,  specific  elements  should  include: 

•  Authority:  FAR  Parts  15.605,  15.608,  and  42.15;  DFARS,  HCA  Instructions  as 
appropriate 

•  Purpose:  To  provide  procedures  for  the  implementation  of  and  compliance  with 
Federal  past  performance  policies 

•  Evaluation  Preparation  Procedures:  Format,  thresholds,  requirement  details 

•  Utilization  in  the  Source  Selection  Process:  Sources  ofPPI,  thresholds.  Sections 
L/M  language,  weighting,  appropriateness  of  use,  new  entrants,  etc. 

•  Rebuttal  Procedures:  Media,  review  and  approval  levels,  etc. 

E.  FEEDBACK  AND  FOLLOW-UP 

Once  the  evaluation  and  source  selection  utilization  requirements  are  initially  satisfied, 
a  feedback  mechanism  needs  to  be  established  to  continue  to  refine  the  processes.  The 
contentious  nature  of  the  past  performance  policy  implementation  initiative  necessitates  a 
process  for  change.  The  environment  will  not  remain  static  so  the  local  policy  should  not  be 
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expected  to.  Once  the  lines  of  communication  are  opened  and  supported,  stakeholders  should 
feel  free  to  continue  to  challenge  the  established  procedures  and  make  recommendations  to 
improve  the  process. 

As  with  any  program  implementation,  a  periodic  follow-up  is  required  at  PNSY  to 
ensure  compliance.  Once  the  basic  elements  of  the  plan  have  been  established,  the 
Contracting  Division  Officer  should  schedule  an  internal  review/assessment  for  a  later  date. 
Given  the  contracting  business  environment,  three  months  would  be  suflScient  to  experience 
a  significant  number  of  evaluation  requirements,  and  a  representative  number  of  source 
selections. 

Another  implementation  method  would  be  to  prescribe  procedures  and  standards  from 
the  top  down  with  minimal  stakeholder  involvement.  This  may  have  the  effect  of  speeding 
up  the  process  of  Federal  policy  implementation,  but  may  also  alienate  or  disenfranchise 
important  personnel  in  the  evaluation  or  source  selection  processes.  Given  the  volume  of 
acquisition  policy  changes  or  reform  initiatives,  a  more  collaborative  approach  seems  justified. 


70 


VI.  SUMMARY,  CONCLUSIONS,  AND  RECOMMENDATIONS 


A.  INTRODUCTION 

The  primary  purpose  of  this  research  was  to  explore  the  issues  surrounding  the 
Federal  Government’s  mandatory  use  of  past  performance  as  a  factor  in  the  source  selection 
process,  and  to  develop  a  strategy  that  would  enable  the  Portsmouth  Naval  Shipyard 
Contracting  Division  to  successfully  implement  a  program  that  would  conform  to  all 
mandatory  and  pertinent  discretionary  guidance.  The  research  questions  addressed  below 
were  crafted  to  satisfy  this  purpose  and  the  answers  provide  a  summary  of  the  research. 
Additional  conclusions  and  recommendations  are  also  provided. 

B.  RESEARCH  QUESTIONS  AND  ANSWERS 

1.  Issues 

What  are  the  issues  associated  with  the  collection  and  utilization  of  contractor  past 
performance  information  in  the  source  selection  process? 

Literally  dozens  of  issues  can  be  raised  concerning  past  performance.  The  following 
is  a  summary  of  some  of  the  more  prevalent  ones: 

a.  Information  Relevance 

Before  unconditionally  accepting  the  notion  that  past  performance  information, 
in  the  broad  sense,  is  an  appropriate  indicator  of  a  contractor’s  ability  to  successfully 
complete  the  requirements  of  a  contract,  it  is  necessary  to  establish  its  relevance.  Using  the 
employee  performance  appraisal  analogy,  one  can  see  that  sustained  superior  performance  is 
a  valid  basis  for  rewards  such  as  promotions  and  bonuses.  Contractors  who  perform  similarly 
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should  also  be  rewarded  via  contract  awards.  The  validity  of  this  notion  has  been  generally 
afBrmed  by  review  authorities  such  as  the  Comptroller  General  and  the  General  Accounting 
Office,  and  has  been  espoused  by  the  leadership  of  both  industry  and  Government. 

Making  the  assumption  that  a  collection  of  PPI  is  accurate  is  another  part  of 
the  overall  relevance  determination.  This  same  information  might  be  unmatched  to  the  target 
organization  or  contract.  The  past  performance  of  a  particular  division  within  a  company  may 
not  be  suitably  applied  to  the  evaluation  of  an  entire  organization.  Likewise,  key  personnel 
are  often  transferred  as  companies  are  merged  and  dissolved  on  a  frequent  basis. 

h.  Evaluations 

In  accordance  with  the  FAR,  evaluations  must  be  prepared  to  document  a 
contractor’s  performance  on  a  given  contract.  Although  it  is  simply  said,  the  practice  is 
influenced  by  a  variety  of  factors.  The  tailored  versus  prescriptive  approach  raises  the  issue 
of  applying  evaluation  standards  or  formats  to  the  multitude  of  contract  actions  in  which  the 
Government  engages.  Rating  areas,  scoring  criteria,  and  information  sharing  are  included  in 
this  category. 

The  resources  required  to  prepare  these  evaluations  are  also  at  issue  in  that 
it  involves  an  activity  not  previously  required.  Contracting  officials,  technical  personnel  and 
customers  all  have  valuable  input  to  an  evaluation,  but  require  time  and  coordination  to 
produce  something  of  value. 

The  value  of  the  evaluation  is  also  influenced  by  the  rebuttal  process.  If  the 
evaluation  contains  information  that  is  inaccurate  due  to  misunderstandings  or 
misinterpretations,  then  it  is  of  little  value  and  could  potentially  eliminate  an  otherwise 
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qualified  offeror.  Rebuttals  are  required  to  eliminate  discrepancies  between  Government 
personnel  and  contractors. 

Even  if  the  data  in  the  evaluation  accurately  describes  the  contractor’s 
performance,  it  may  be  so  old  that  it  is  not  a  true  indication  of  what  the  contractor  is  capable 
of  doing  at  present.  Trends  of  improvement  or  decline  could  be  overlooked  or  negatively 
influenced  by  averaging  information  which  is  “too  old.” 

c.  References 

References  are  another  key  source  of  past  performance  information.  Solicited 
Jfrom  Government,  commercial,  and  state/local  sources,  references  are  an  indication  of  how 
well  the  contractor  performed  on  similar  contracts.  A  variety  of  issues  are  raised  when  the 
contractor  provides  references  to  the  contracting  activity. 

“Cherry  picking”  is  the  contractor  practice  of  providing  only  those  references 
that  are  beneficial  to  his  position  in  the  competitive  process.  Source  selection  officials  need 
to  ensure  that  contractors  provide  all  relevant  references. 

The  age  of  the  information  is  also  a  factor  with  regard  to  references.  Although 
the  FAR  limits  the  storage  of  PPI  to  three  years,  the  utilization  of  references  older  than  three 
years  is  not  specifically  addressed.  This  could  be  beneficial  to  either  the  contractor  or  the 
Government  depending  on  the  evaluation  resulting  from  the  reference. 

Rebuttals  or  challenges  are  also  required  for  references  as  they  are  sources  of 
past  performance  evaluation  information.  The  rebuttal  or  challenge  process  produces  the 
same  benefits  as  in  the  evaluation  category,  but  slows  the  source  selection  process  further  as 
contractors  have  a  minimum  of  thirty  days  to  respond. 
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d.  Automated  Data  Processing  Systems 

In  order  to  achieve  the  benejSts  of  sharing  past  performance  information 
among  contracting  activities  and  aid  in  the  streamlining  of  the  source  selection  process,  a 
system  or  systems  must  be  established  to  deal  with  the  enormous  amount  of  data  that  will  be 
produced  as  a  result  of  the  contractor  evaluation  requirement.  Automated  Data  Processing 
Systems  designed  to  archive  and  distribute  PPI  are  subject  to  the  same  problems  of  format 
and  validity  as  manual  systems,  and  experience  the  additional  challenges  of  compatibility, 
parochialism,  and  centralization  vs.  decentralization. 

e.  Solicitation  and  Source  Selection 

As  is  the  case  with  any  factor  or  scoring  methodology  used  in  the  source 
selection  process,  the  use  of  past  performance  must  be  clearly  delineated  in  the  solicitation 
and  then  applied  as  described.  Additionally,  the  factors  and  subfactors  must  be  tailored  to 
each  acquisition  and  must  have  an  impact  on  the  source  selection  decision.  The  key  to  the 
use  of  past  performance  is  the  establishment  of  a  clear  relationship  between  the  statement  of 
work  (SOW)  in  Section  L  of  the  solicitation,  and  the  evaluation  criteria  in  Section  M.  These 
sections  should  also  be  clear  with  regard  to  what  PPI  will  be  evaluated  and  how  it  will  be 
weighted. 

2.  Guidance 

What  are  the  current  statutory.  Federal,  departmental,  agency,  and  local  policies  with 
regard  to  contractor  past  performance  measurement,  utilization,  storage,  and  retrieval? 

The  FAR  is  currently  the  primary  source  of  mandatory  past  performance  guidance. 
The  proposed  DFARS  language,  that  was  intended  to  prescribe  an  evaluation  format  and  to 


74 


implement  the  FAR  milestones,  has  been  suspended  pending  further  review.  Subordinate 
guidance  from  the  Navy  and  System  Commanders  is  in  process.  Discretionary  guidance  is 
provided  mainly  from  the  OFPP  Best  Practices  Guide  for  Past  Performance.  The  basic 
guidance  in  effect  as  of  this  writing  consists  of  two  elements,  the  evaluation  preparation 
requirement  and  the  information  utilization  requirement. 

Agencies  are  required  to  prepare  an  evaluation,  “at  the  time  the  work  under  the 
contract  is  completed,”  for  each  contract  above  the  $500,000  threshold,  as  of  1  July  1996. 
Commencing  1  January  1998  this  threshold  will  be  reduced  to  $100,000.  In  order  to  provide 
current  information  for  source  selection  purposes,  interim  evaluations  “should”  also  be 
prepared  for  contracts  with  periods  of  performance  over  one  year  Exceptions  to  this  rule 
include  acquisitions  awarded  under  FAR  Part  8.6  or  8.7;  that  is,  the  Federal  Prison  Industries 
Inc.  (UNICOR)  and  nonprofit  agencies  employing  people  who  are  blind  or  severely  disabled. 

As  of  1  July  1995  past  performance  must  be  evaluated  for  each  competitively 
negotiated  procurement  expected  to  exceed  $1,000,000.  This  threshold  is  expected  to  be 
reduced,  pending  further  revision,  to  $500,000  on  1  July  1997  and  to  $100,000  on  1  January 
1999.  This  requirement  essentially  adds  another  mandatory  source  selection  factor,  cost  (or 
price)  and  quality  being  the  other  two,  unless  the  contracting  officer  documents  why  past 
performance  should  not  be  used  in  the  contract  file.  Agencies  have  “broad  discretion”  in 
selecting  the  number  of  factors  and  their  weighting  so  long  as  they  have  a  desired  impact  on 
the  source  selection  decision.  Agencies  also  have  the  option  of  developing  their  own 
implementation  schedule  provided  it  falls  within  the  aforementioned  milestone. 
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3.  Past  Performance  Information  Systems 

What  past  performance  information  systems  are  currently  available  and  what  are  their 
capabilities? 

There  are  a  multitude  of  programs/systems  throughout  DOD  that  are  available  to  help 
contracting  officials  collect,  archive,  distribute,  and  utilize  past  performance  information. 
Depending  on  how  one  defines  a  past  performance  information  system,  there  are  at  least  thirty 
five  systems  currently  in  use.  These  systems  can  be  classified  into  three  main  types: 
performance  tracking  systems,  performance  appraisal  systems,  and  performance/quality 
certification  systems.  Although  most  of  these  systems  will  not  have  an  application  to  the 
Portsmouth  Naval  Shipyard,  there  are  several  that  hold  great  potential  for  use.  The  primary 
ones  are  the  Product  Deficiency  Reporting  and  Evaluation  Program  (PDREP)  and  the 
RED/YELLOW/GREEN  (RA^/G)  Program. 

PDREP  is  a  Navy-wide  automated  system  that  tracks  the  product/material  quality  of 
items  provided  by  the  supplying  contractor.  Managed  by  the  Navy  Material  Quality 
Assessment  Office  (NMQAO)  in  Portsmouth  NH,  PDREP  is  intended  to  provide  a  more 
effective  use  of  quality  assurance  and  delivery  information  by  combining  source  data  firom  all 
Navy  System  Commanders  (SYSCOMS)  into  a  single  system.  Additionally,  it  is  intended  to 
improve  the  reliability  and  maintainability  of  purchased  material,  thereby  assisting  Navy 
personnel  in  making  a  more  objective  award  decision/determination.  Users  may  access 
PDREP  products  via  software  applications,  installed  on  their  personal  computers  or  office 
servers,  and  a  modem  link  to  NMQAO. 
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The  RA7G  Program  is  a  performance  tracking  system  established  to  help  reduce  the 
risk  of  receiving  nonconforming  products  and  late  shipments.  Primarily  designed  for 
purchases  below  the  Simplified  Acquisition  Threshold  (SAT)  of  one  hundred  thousand 
dollars,  RA^/G  utilizes  the  PDREP  electronic  data  base  and  assigns  a  color  performance  risk 
classification  to  represented  contractors.  It  assists  buyers  in  making  best  value,  low  risk 
awards  vice  “low  cost,”  high  risk  awards,  and  utilizes  the  following  designations:  red 
represents  high  performance  risk,  yellow  is  moderate  risk,  and  green  is  low  risk.  There  is  also 
a  neutral  or  “not  applicable”  category  for  those  contractors  who  do  not  have  a  record  of  past 
performance  within  the  requested  FSC.  Utilizing  software  resident  within  the  PDREP 
package,  buyers  query  the  system  for  classifications  on  a  particular  contractor  and  for  the 
class  of  products  required.  An  internal  system  algorithm  then  applies  a  price  estimate 
adjustment  to  contractors  with  a  red  or  yellow  rating  in  order  to  potentially  displace  them 
behind  a  “green”  offeror  who  bid  a  higher  price. 

4.  The  Portsmouth  Naval  Shipyard  Environment 

What  is  the  current  environment  in  which  PNSY  operates,  and  how  does  it  impact  the 
implementation  of  Federal  past  performance  policies? 

The  Portsmouth  Naval  Shipyard’s  primary  business  is  repairing  the  fleet’s  nuclear 
attack  submarines.  Repairs  can  be  effected  via  overhauls  and  availabilities  at  the  shipyard,  or 
via  “fly  away”  crews  that  travel  to  submarine  home  ports  such  as  Norfolk,  VA  and  San 
Diego,  CA.  In  support  of  this  mission,  the  Contracting  Division  provides  purchasing  and 
contracting  services  for  the  Shipyard.  Although  the  Shipyard  is  the  primary  customer,  the 
Contracting  Division  provides  support  for  a  multitude  of  customers  including;  submarines 
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at  the  shipyard,  repair  shops,  the  PNSY  Supply  Department,  the  PNSY  Naval  Medical  Clinic, 
Defense  Marketing  and  Reutilization  Office  (DRMO),  NISE  West,  NISE  East,  SUBMEPP, 
NAVSEA,  SPCC,  and  SPAWAR. 

The  PNSY  Contracting  Division  has  gained  procurement  experience  in  a  broad 
spectrum  of  supplies  and  services.  Experience  ranges  from  marine  equipment,  construction 
materials,  and  fiber  optic  components  to  social  services,  lodging,  and  education  and  training 
services.  This  diversity  has  an  impact  on  what  t3q)es  of  past  performance  information  will 
be  utilized  in  the  source  selection  process,  and  the  types  that  will  be  evaluated  on  a  recurring 
basis.  Also  impacting  PNSY’s  utilization  of  PPI  and  evaluation  of  past  performance  is  the 
volume  of  contract  actions  in  general,  and  the  number  of  competitively  negotiated 
procurements  specifically. 

New  contract  actions  make  up  approximately  19%  of  the  total  reported  contracting 
actions.  The  vast  majority  of  contract  actions,  vice  simplified  acquisitions,  are  comprised  of 
modifications,  delivery  orders,  and  task  orders.  Depending  on  the  interpretation  of  the  FAR 
requirement  to  prepare  evaluations  for  “each  contract”  the  number  of  evaluations  required 
to  be  prepared  at  PNSY  varies  greatly. 

The  number  of  competitively  negotiated  contracts  over  the  $100,000  threshold 
averages  thirteen  per  year.  Source  selection  officials  would  therefore,  be  required  to  use  past 
performance  in  the  source  selection  process  at  the  rate  of  approximately  one  per  month  if  the 
business  climate  remains  the  same.  Regardless  of  the  number  of  competitively  negotiated 
procurements,  procedures  need  to  be  in  place  to  utilize  the  past  performance  information. 
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This  would  help  preclude  inconsistencies  in  the  command  specific  treatment  of  contractors 
and  their  proposals. 

5.  Implementation  Plan 

How  could  the  elements  of  the  Federal  Government’s  policy  with  regard  to  utilizing 
contractor  past  performance  data  in  the  source  selection  process,  be  most  efficiently  and 
effectively  implemented  at  the  Portsmouth  Naval  Shipyard? 

The  following  basic  steps  should  be  followed  in  order  to  successfully  implement  the 
Federal  past  performance  policies: 

•  Communicate  the  content  and  intent  of  the  policy  to  all  stakeholders 

•  Establish  evaluation  and  reference  formats 

•  Establish  Standard  Operating  Procedures  for  preparing  evaluations  and  for  utilizing 
past  performance  information  in  the  source  selection  process 

•  Establish  feedback  and  follow-up  mechanisms  to  monitor  the  effectiveness  of  the 
policy  implementation 

C.  RECOMMENDATIONS 

In  addition  to  the  implementation  plan  outlined  in  Chapter  V,  the  following 
recommendations  are  provided: 

1.  Vision 

The  Department  of  Defense  should  provide  an  overall  vision  of  what  a  future  past 
performance  program  should  look  like.  Instead  of  the  prescriptive  language  proposed  for  the 
DFARS,  which  is  not  suited  for  all  contracting  organizations,  the  DOD  should  allow  agencies 
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to  establish  procedures  that  are  tailored  to  their  individual  requirements.  This  does  not 
preclude  a  unified  system  of  some  sort,  but  at  present,  such  a  proposition  is  not  realistic. 

2.  “Clearing  House” 

The  establishment  of  a  past  performance  information  clearing  house  should  be 
explored  with  Federal  and  DOD  resources.  The  concept  basically  involves  a  centralized 
identification,  routing,  and  facilitation  system  that  could  link  the  variety  of  PPIS  currently 
deployed,  and  those  under  development.  Users  could  access  information  from  any  data  base, 
in  the  format  utilized  by  the  originating  system.  The  system  should  not  actually  store  the  data, 
but  should  route  requests  for  information  to  the  appropriate  local,  regional,  or  business  profile 
based  system.  It  should  incorporate  both  Electronic  Document  Interchange  and  open 
architecture/compatible  data  base  features. 

3.  Scoring  Criteria  Overlay 

The  Federal  Government  and  DOD  should  establish  a  past  performance  subfactor 
scoring  system  that  incorporates  and  equates  the  three  most  prevalent  scoring  systems. 
Color,  adjectival,  and  numerical  scoring  criteria  should  be  equated  to  each  other  at  the 
business  area  or  even  command  levels.  This  would  allow  an  organization  to  utilize  which  ever 
scoring  criteria  it  wished  but  would  provide  compatibility  information  for  a  requestor  who 
uses  a  different  system.  A  “red”  classification  from  one  agency  could  be  registered  as 
equating  to  an  unsatisfactory  adjectival  rating,  or  a  zero  on  a  five  point  scale.  This  system 
would  be  a  compromise  between  the  tailored  versus  prescriptive  approaches  as  commands 
could  still  use  the  system  which  they  prefer,  but  the  meaning  of  their  ratings  could  be 
translated  to  other  users. 
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D.  AREAS  FOR  FUTURE  RESEARCH 


The  past  performance  issue  is  receiving  an  incredible  amount  of  attention  throughout 
the  Federal  Government  and  Industry.  Although  most  will  agree  that  it  makes  sense  to  award 
to  a  contractor  who  has  a  proven  performance  record,  the  issues  of  how  to  fairly  use  the 
information  and  still  benefit  fi'om  its  use,  have  created  a  plethora  of  unresolved  questions. 
Specifically,  the  following  areas  need  to  be  addressed: 

1.  Commercial  Practices 

How  can  commercial  practices  with  regard  to  supplier  past  performance  be  applied 
to  Government  organizations  in  light  of  competition  and  socio-economic  goals?  Would  the 
commercial  practice  of  establishing  long  term  supplier  relationships  limit  competition? 

2.  Predictive  Validity 

What  is  the  correlation  between  the  preaward  past  performance  evaluation  and  actual 
contract  performance?  Should  past  performance  be  a  mandatory  factor  in  the  source  selection 
process? 

3.  Centralization  versus  Decentralization 

Should  the  Department  of  Defense  adopt  a, centralized  past  performance  information 
system  vice  a  decentralized  one?  What  are  the  tradeoffs  between  substantative  information 
collection  and  ease  of  use? 

4.  Tailored  versus  Prescriptive  Approaches 

Should  the  Department  of  Defense  prescribe  a  particular  past  performance  evaluation 
format,  or  allow  subordinate  activities  to  tailor  it  to  their  needs? 
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APPENDIX  A.  DFARS  CASE  95-D715 


Tab  A 

DFARS  Case  95-D715 
Past  Performance 

DRAFT  FINAL  DFARS  LANGUAGE 
Baseline:  DAC  91-7 

[213.106-1  Soliciting  competition,  evaluation  of  quotes,  and  award 

(b)(1)  Use  of  past  performance  information  is  not  mandatory  for  solicitations  not  expected 
to  exceed  $100,000,  however,  it  is  encouraged.] 

[214.201-8(a)  An  offeror’s  record  of  past  performance  may  be  used  as  an  indication  of 
foreseeable  costs  and  delays  and  may  be  evaluated  where  these  costs  can  be  reduced  to  a 
price-related  evaluation  factor.  For  example,  where  a  poor  performance  record  requires  a 
preaward  survey  or  where  a  record  of  delivering  nonconforming  parts  would  require 
source  inspection,  and  a  preaward  survey  or  source  inspection  would  not  otherwise  be 
required,  an  evaluation  factor  covering  those  additional  costs  may  be  applied.  The  method 
by  which  these  price-related  factors  will  be  determined  and  applied  shall  be  included  in  the 
solicitation.] 
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215.605  Evaluation  Factors 

[(b)(l)(ii)  Notwithstanding  the  implementation  dates  in  FAR  15.605(b)(ii),  past 
performance  shall  be  evaluated  in  all  competitively  negotiated  acquisitions  expected  to 
exceed  $1  million  issued  on  or  after  July  1,  1995  and  expected  to  exceed  $100,000  issued 
on  or  after  July  1,  1997,  unless  the  contracting  ofiBcer  documents  the  contract  file  with  the 
reasons  why  past  performance  should  not  be  evaluated.  When  past  performance  is 
evaluated,  it  should  be  a  significant  evaluation  factor  or  significant  subfactor.  Although 
the  use  of  past  performance  is  not  mandatory  for  solicitations  not  expected  to  exceed 
$100,000,  it  is  encouraged.  Past  performance  information  from  contractor  performance 
evaluations  shall  not  be  used  in  source  selections  until  the  requirements  of 242.1503(b) 
have  been  met] 

(B)[(2)]  In  acquisitions  which  require  use  of  the  clause  at  FAR  52.219-9,  Small  Business 
and  Small  Disadvantaged  Business  Subcontracting  Plan,  the  extent  of  participation  of 
small  and  small  disadvantaged  businesses  in  performance  of  the  contract  shall  be  addressed 
in  source  selection.... 
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[SUBPART  242.15-CONTRACTOR  PERFORMANCE  INFORMATION 
242.1502  PoUcy 

(a)  Notwithstanding  FAR  42. 1502(a),  contractor  performance  evaluations  shall  be 
prepared  for  all  contracts  in  excess  of  $1  million  effective  July  1,  1995  and  all  contracts 
exceeding  $100,000,  effective  January  1,  1997.  For  contracts  exceeding  18  months, 
interim  evaluations  shall  be  prepared  annually. 

(a)(70)  Past  Performance  Information  Collection  Procedures. 

(a)  Agencies’  evaluation  of  contractor  performance  shall  include: 

(1)  Whether  the  report  is  final  or  interim  report; 

(2)  What  period  the  report  covers; 

(3)  The  contractor’s  name,  address  and  telephone  number; 

(4)  The  contract  number,  initial  value,  award  date,  and  completion  date; 

(5)  The  type  of  contract  and  whether  or  not  it  resulted  from  competition; 

(6)  The  FSC  and  Service  Code,  and  a  description  of  the  requirement;  and 

(7)  An  evaluation  of  contractor’s  performance  in  the  following  areas, 
including  a  rating  and  supporting  rationale: 

(i)  (A)  Quality  of  Product  or  Service  (Mandatory).  This  may 

include  the  following  aspects  of  performance: 

(a)  Compliance  with  contract  requirements; 

(b)  Accuracy  of  reports;  and 

(c)  Appropriateness  of  contractor  personnel  assigned  to  the 
contract. 

(B)  The  following  adjectival  ratings  shall  be  used  when  rating 
Quality  of  Product  or  Service  (a  required  element): 

(a)  Unsatisfactory.  Nonconformances  compromise  (or  are 
compromising)  the  achievement  of  contract 
requirements,  despite  the  use  of  Agency  resources. 

(b)  Marginal.  Nonconformances  require  Agency  resources 
to  ensure  achievement  of  contract  requirements. 

(c)  Satisfactory.  Nonconformances  do  not  impact  the 
achievement  of  contract  requirements. 

(d)  Excellent.  There  are  no  quality  problems. 

(ii) (A)  Cost  Control  (not  required  for  firm-fixed-price  and  firm- 
fixed-price  with  economic  price  adjustment  contracts).  This  may 
include  the  following  aspects  of  performance: 

(a)  The  relationship  of  negotiated  cost  to  actuals; 
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(b)  Cost  containment  initiatives;  and 

(c)  The  number  and  cause  of  change  orders  issued. 

(B)  The  following  adjectival  ratings  shall  be  used  when  rating 
Cost  Control: 

(a)  Unsatisfactory.  Cost  issues  are  compromising 
performance  of  contact  requirements. 

(b)  Marginal.  Cost  issues  required  (or  require)  Agency 
measures  to  ensure  achievement  of  contract 
requirements. 

(c)  Satisfactory.  Cost  issues  do  not  impact  achievement  of 
contract  requirements. 

(d)  Excellent.  There  are  no  cost  issues. 

(iii) (A)  Timeliness  of  Performance  (mandatory).  This  may  include 

the  following  aspects  of  performance: 

(a)  Whether  the  contractor  met  performance  milestones; 

(b)  Contractor’s  responsiveness  to  technical  direction; 

(c)  Contractor’s  responsiveness  to  contract  change  orders 
and  administrative  requirements; 

(d)  Whether  the  contract  was  completed  on  time,  including 
contract  administration;  and 

(e)  Whether  liquidated  damages  were  assessed. 

(B)  The  following  adjectival  ratings  shall  be  used  when  rating 

Timeliness  of  Performance  (a  required  element): 

(a)  Unsatisfactory.  Delays  are  compromising  the 
achievement  of  contract  requirements,  despite  the  use  of 
Agency  resources. 

(b)  Marginal.  Delays  require  Agency  resources  to  ensure 
achievement  of  contract  requirements. 

(c)  Delays  do  not  impact  achievement  of  contract 
requirements. 

(d)  Excellent.  There  were  no  delays. 

(iv) (A)  Contracting/Business  Relations  (a  discretionary  element). 

This  may  include  the  following  aspects  of  performance: 

(a)  Whether  the  contractor  effectively  managed  the  contract 
effort; 

(b)  How  promptly  the  contractor  notified  the  Government 
of  problems; 

(c)  Whether  the  contractor  was  reasonable  and  cooperative; 

(d)  Was  the  contractor  proactive; 
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(e)  How  effective  were  contractor-recommended  actions; 

(Q  Did  the  contractor  effectively  implement  socio¬ 
economic  programs,  including  compliance  with 
requirements  of  the  clause  at  FAR  52.219-8,  Utilization  of 
Small  Business  Concerns  and  Small  Disadvantaged 
Business  Concerns,  and  52.219-9,  Small  Business  and 
Small  Disadvantaged  Business  Subcontracting  Plan;  and 
(g)  Current,  accurate,  and  complete  billings. 

(B)  The  folloAving  adjectival  rating  shall  be  used  when  rating 
Contracting/Business  Relations: 

(a)  Unsatisfactory.  Response  to  inquiries,  technical 
service,  and  administrative  issues  is  not  effective  and 
responsive. 

(b)  Marginal.  Response  to  inquiries,  technical  service,  an 
administrative  issues  is  marginally  effective  and 
responsive. 

(c)  Satisfactory.  Response  to  inquiries,  technical  service, 
and  administrative  issues  is  usually  effective  and 
responsive. 

(d)  Excellent.  Response  to  inquiries,  technical  service,  and 
administrative  issues  is  always  effective  and 
responsive. 

(v)  Rater’s  Overall  Assessment.  Based  on  the  above  criteria 
[Unsatisfactory,  Marginal,  Satisfactory,  or  Excellent.] 

(8)  An  evaluation  of  key  contractor  personnel  for  services  and  R&D 
contracts  (applies  only  to  contractually  designated  individuals); 

(9)  The  evaluator’s  name,  address,  telephone  number  and  dated  signature; 

(10)  Whether  the  contractor  provided  comments,  rebuttals  or  additional 
information.  If  such  information  was  provided,  it  shall  be  attached  to 
the  Government  evaluation; 

(1 1)  A  resolution  of  contractor  comments;  and 

(12)  The  final  review  authority’s  name,  address,  phone  number,  and  dated 
signature. 

242. 1 503  Procedures 

(a)  The  contracting  officer  will  determine  who  provides  input  on  the  contractor 
performance  evaluations.  Where  the  contract  has  been  delegated  for  administration,  the 
cognizant  AGO  shall  complete  performance  evaluations  unless  otherwise  advised  by  the 
PCO. 

(b) (70)  The  agency  or  designee  preparing  the  performance  evaluation  shall  be  responsible 
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for  ensuring  that  the  past  performance  information  recorded  is  in  compliance  with  FAR 
42. 1503(b)  prior  to  its  use. 

(b)(71)  If  the  contractor  does  not  respond  within  the  period  specified,  the  data  may  be 
assumed  to  be  accurate  and  may  be  used  in  source  selections. 

(e)  The  date  of  completion  of  contract  performance  is  the  date  of  contract  closeout.] 
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APPENDIX  B.  EXISTING  PAST  PERFORMANCE  INFORMATION  SYSTEMS 


Acronym 

System/EVocess  Name 

Owner 

1 

ABVM 

Automated  Best  Value  Model 

DLA 

2 

ACASS 

A&E  Contract  Administration  Support  System 

AimyCOE 

3 

ACPS 

Automated  Contract  Preparation  System 

Air  Force 

4 

ACTS 

Automated  Configuration  Tracking  System 

DCMC 

5 

AMS 

Acquisition  Management  Information  System 

Air  Force 

6 

BCAS 

Base  Contracting  Automation  System 

Air  Force 

jj^H 

BRP 

Blue  Ribbon  Program 

AllDOD 

« 

C/SSR 

Cost/Schedule  Status  Reports 

AllDOD 

9 

CCASS 

Construction  Contract  Appraisal  System 

ArmyCOE 

10 

ccss 

Commodity  Command  Standard  System 

Army 

11 

CDCS 

Customer  Depot  Complaint  System 

DLA 

12 

CIS 

Contractor  Information  System 

Army 

13 

CIS 

Contractor  Information  Service 

DCMC 

14 

CPARS 

Contract  Performance  Assessment  Report,  Sys, 

Air  Force 

15 

CPR 

Cost  Performance  Reports 

AUDOD 

16 

CPS 

Contractor  Profile  System 

DCMC 

17 

DPACS 

DLA  Preaward  Contracting  System 

DLA 

18 

GIDEP  Alert 

Gov’t  Industry  Data  Exchange  Program  Alerts 

DOD 

19 

J041 

Acquisition  and  Due  In  System 

Air  Force 

20 

JACG-IPT 

Joint  Aeronautical  Cdrs  Group  IPT 

Joint/DLA 

21 

MIR 

Material  Inspection  Records 

Navy 

22 

MOCAS 

Mechanization  of  Contract  Admin.  Services 

DCMC 

23 

PADDS 

Procurement  Automated  Data  &  Doc.  System 

Army 

24 

PASS 

Preaward  Survey  System 

DCMC 

25 

PDREP 

Product  Deficiency  Reporting  &  Evaluation  Sys 

Navy 

26 

PQDR 

Product  Quality  Deficiency  Reports 

DCMC 

27 

PRAG 

Performance  Risk  Assessment  Groups 

Army/AF 
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28 

PROCAS 

Process  Oriented  Contract  Admin.  Services 

DCMC 

29 

QPL 

Qualified  Parts  List 

Navy 

30 

RAM 

Risk  Assessment  Model 

DCMC 

31 

RYG 

RedfY  ellov^/Green 

Navy 

32 

SAACS 

Standard  Army  Automated  Contracting  System 

Army 

33 

SALT 

System  Analysis  and  Lab  Testing 

DLA 

34 

SAMMS 

Standard  Automated  Material  Management  Sys. 

DLA 

35 

VRS 

Vendor  Rating  System 

Air  Force 
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APPENDIX  C.  PROCUREMENT  EXPERIENCE 


SUPPLIES 

SERVICES 

Ships  and  Marine  Equipment 

Social  Services 

Engines,  Turbines,  and  Components 

Maintenance  and  Repair  of  Equip,  MHE 

Water  Purification  &  Sewerage  Treatment 

Quality  Control,  Testing  and  Inspection 

Fire  Fighting,  Rescue  and  Safety  Equip. 

Maintenance  of  Indust.  Comm.  Equip. 

Pumps  and  Compressors 

Technical  Respresentative  Services 

Construction  and  Building  Materials 

Tools,  Machines,  ADP  Equipment 

Chemicals  and  Chemical  Products 

Fuel  Handling  and  Distribution  Systems 

Furniture 

Engineering  and  Admin./Mgt  Support 

Metalworking  Machinery 

Education  and  Training 

Pipe,  Tubing,  Hose  and  Fittings 

Lodging 

Refrigeration,  AC  &  Air  Circulating  Equip 

Lease  and  Rental  of  Indust.  Equip./Tools 

Instruments  and  Laboratory  Equipment 

Laundry  Services 

Nonmetallic  Fabricated  Materials 

Mortuary  Services 

Fiber  Optics  Mat’l,  Comp.,  Assemblies 

Medical  Services 

General  Purpose  ADP  Equip.,  Software 

Land  Surveys,  Casdastral  Services 

Textiles 

Disposal  of  Excess  &  Surplus  Property 

Ship  and  Boat  Propulsion  Components 

Vocational/Technical  Training  Services 
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APPENDIX  D.  PROPOSED  EVALUATION  FORMAT 


[]  Final 


CONTRACTOR  PERFORMANCE  EVALUATION 
[  ]  Interim:  From _ To 


|l.  Contractor  Name  /  Address 
( Identtfy  Division/Plant) 


2.  Contract  Number:_ 

3.  Contract  Value: 


4.  Contract  Award  Date: 

5.  Contract  CompL  Date: 


6.  Type  of  Contract:  FP  FPI  FP/EPA  CPFF  CPEF  CPAF 

(Orcle  all  applicable)  ID/IQ  BOA  REQ.  T&M  Other 


Sealed  Bid  Negotiated  Competitive  Non-Comp. 


7.  Description  of  Requirement: 


8.  Ratings:  Summarize  or  distinguish  contractor  pertormance  in  the  remarks  section. 
Indentify  rating  method  preferred  (adjectival,  numerical,  color)  and  indicate  the 
rating  by  placing  an  “x”  along  the  scale  within  each  rating  area) 


■ 

Adjectival 

Unsatisfactory 

Marginal 

Satisfactory 

Excellent 

■ 

Numerical 

0 

1 

2 

3 

Color 

Red 

1  Yellow 

1 _ '< 

jreen 

Quality 

Remarks  | 

:  1 

1 

1 

1 

I 

Cost  Control 

Remarks  i 

:  i 

:  1 

:  1 

:  t 

! I 

Timeliness 

Remarks  i 

:  1 

;  1 

1 

1 

1 

- ^ - 

Business  Relations 

.  i 

Remarks  :  ] 

i  1 

;  j 

i 

1 

I 

1 

Customer  Satisfaction 

Remarks  i  1 

1 

1 

1 

1 

- ^ - 

Key  Personnel 

Remarks  j 

- ^ ^ - 

i 

1 

j 

Overall 

- ^ - 

1 

1 

I 

1 

1 

1 

1 

(Front) 
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9.  Key  Personnel:  (Optional) 


(Name) 

(Rating) 

(Employment  Dates) 

(Additional  Comments) 

(Name) 

(Rating) 

(Employment  Dates) 

(Additional  Comments) 

(Name) 

(Rating) 

(Employment  Dates) 

(Additional  Comments) 

10,  Contracting  Officer’s  Recommendation: 

Given  what  I  know  today  about  the  contractor’s  ability  to  execute  what  he  promised  in  his  proposal/oflfer 
I:  (definitely  would  not,  probably  would  not,  might  or  might  not,  probably  would  or  definitely  would) 
award  to  him  today  given  that  I  had  a  choice.  (Please  circle  one) _ 

1 1,  Contractor  Review:  Has  the  contractor  reviewed  this  evaluation?  Yes  /  No 

_ (Please  attach  comments  if  applicable) _ 

12,  Additional  Qualitative  Comments: 


*  Rating  areas  and  scales  are  defined  via  the  following  guidance:  Color  -  Navy  RedA^ellow/Green  Program 
Adjectival  and  Numerical  -  DFARS  Part  242. 15  **  Reference  Evaluators  may  provide  scale  in  use  and 
evaluate  accordingly.  _ 


(Back) 
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APPENDIX  E.  SAMPLE  SOUCUATION  LANGUAGE 


SECTION  L  -  INSTRUCTIONS,  CONDITIONS,  AND  NOTICES  TO  OFFERORS 


L-X  GENERAL  INFORMATION  REGARDING  PAST  PERFORMANCE 

(a)  Past  Performance.  The  evaluation  will  include  and  assessment  of  past 
performance  by  review  of  data  presented  by  the  offeror,  data  in  existing  Government  data 
bases,  data  from  cognizant  procuring  and  contract  administration  offices  and  data  from 
on-site  surveys  and  quality  certifications.  Problems  found  in  this  data  which  have  not  been 
addressed  by  the  offeror  will  be  assumed  to  be  still  in  existence.  The  past  performance 
inputs  will  be  used  to  assess  the  risk  of  future  performance  on  the  proposed  contract. 

(b)  References.  Offerors  shall  submit  the  following  information  in  section  XX  of 
their  proposal: 

1 .  A  list  of  the  last  XX  relevant  contracts  completed  by  the  offeror, 
including  the  following  information  about  each  contract: 

a.  Name  of  the  contracting  activity 

b.  Contract  Number 

c.  Contract  Title 

d.  Face  value  at  award,  including  all  options 

e.  PCO  name  and  telephone  number 

f  Program  manager  name  and  telephone  number  (if  applicable) 

g.  ACO  name  and  telephone  number  (if  applicable) 

h.  Contract  type 

i.  Basic  contract  award  amount 

j.  Current  contract  award  amount 

k.  Final  project  contract  amount 

l.  Original  delivery  schedule 

m.  Current  dehvery  schedule 

n.  Short  description  of  requirement 

o.  Description  of  your  performance  to  date,  including  corrective 
actions  taken,  with  regard  to  cost,  delivery,  quality 

p.  Description  of  major  subcontracts  (if  applicable) 

2.  (OPTIONAL)  A  list  of  any  other  contracts  completed  in  the  last  XX 
years  that  demonstrates  your  commitment  to  customer  satisfaction  or  professional 
business  relations.  Also  list  any  key  personnel  who  may  have  had  a  significant  role  in  the 
performance  of  similar  contracts  for  other  contractors.  (Cite  appropriate  company 
identification  information) 

(c)  Additional  Sources.  Offerors  may  submit  relevant  past  performance 
information  from  commercial  and  state/local  government  entities. 

SECTION  M  -  EVALUATION  FACTORS  FOR  AWARD 
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M-X  Past  Performance 


1.  Past  performance  will  receive  XX  percent  of  the  non-cost/price  factor  ratings. 
Subfactors  A,  B,  C,  and  D  are  of  equal  importance  and  will  receive  up  to  XX  percent  of 
the  non-cost/price  ratings. 


:i|c  :|c  sic  3jc  3|i  :|e  jf: 


M-X  EVALUATION  CRITERIA 

1 .  Offers  will  be  assessed  on  the  basis  of  price,  quality  of  the  technical  proposal, 
and  the  offeror’s  past  performance  with  past  performance  being  more  important  than  price 
and  technical  proposal  combined.  Price  is  slightly  more  important  than  technical  proposal, 
a.  Past  performance  will  be  assessed  as  follows: 

1.  The  Government  will  consider  the  offeror’s  record  of  conforming  to 
specifications/commericial  product  descriptions  and  to  standards  of  good  workmanship; 
the  offeror’s  adherence  to  contract  schedules,  including  the  administrative  aspects  of 
performance;  the  offeror’s  record  of  managing  subcontractor  delivery  and  performance; 
the  offeror’s  record  of  controlling  costs  under  cost-type  contracts;  the  offeror’s  record  of 
change  orders  under  similar  contracts;  the  offeror’s  reputation  for  reasonable  and 
cooperative  behavior  and  commitment  to  customer  satisfaction;  and  generally,  the 
offeror’s  business-like  concern  for  the  interests  of  the  customer. 


*  *  *  *  He  * 


M-X  PAST  PERFORMANCE  FACTOR 

During  the  source  selection  process,  the  Government  will  assess  the  offeror’s 
ability  to  perform  on  the  instant  contract/order,  including  the  offeror’s  likelihood  of 
achieving  success  in  meeting  the  solicitation’s  requirements.  Past  performance  is  assessed 
by  the  Source  Selection  Authority/Contracting  Officer  and  is  assigned  a  narrative  rating  in 
the  evaluation. 
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APPENDIX  F.  STANDARD  OPERATING  PROCEDURES 


SECTION  XX:  PAST  PERFORMANCE  IN  THE  SOURCE  SELECTION 
PROCESS 

Purpose:  This  section  provides  guidance  on  the  requirement  to  utilize  past 

performance  in  the  source  selection  process  and  the  requirement  to 
prepare  performance  evaluations. 

Ref:  (a)  FAR  Parts  15.605;  15.608;  42.15 

DFARS  Parts  XXX 

(c)  NAVSEA/NAVSUP/CINCLANTFLT  Instructions 

(d)  OFPP  Best  Practices  Guide  on  Contractor  Past  Performance 

End:  (1)  NAVSHIPYD-PTSMH  Form  XX  -  Contractor  Performance 

Evaluation 

(2)  Sample  Solicitation  Language 

PART  I.  USING  PAST  PERFORMANCE  IN  SOURCE  SELECTIONS 

1.  As  per  reference  (a),  and  pending  revisions  of  references  (b)  and  (c),  past  performance 
shall  be  included  in  all  competitively  negotiated  source  selections  in  accordance  with  the 
following  schedule: 


Contract  Value 

Prepare  Evaluation 

Utilize  in  S/S 

>  $1,000,000 

1  July  1995 

1  July  1995 

>  500,000 

1  July  1996 

1  July  1997 

>  100,000 

1  Jan.  1998 

1  Jan.  1999 

2.  Broad  discretion  is  afforded  to  the  contracting  officer  and  source  selection  officials 
with  regard  to  the  specific  subfactors  and  rating  criteria  that  must  be  included  in  the 
solicitation  and  subsequently  evaluated.  The  specific  weighting  should  be  tailored  to  the 
particular  procurement.  In  general,  past  performance  shall  be  a  “significant”  factor  in  the 
source  selection  process.  The  following  steps  should  be  taken  as  appropriate: 

a.  Document  the  use  of  past  performance  in  the  RFP  (Section  L/M).  Enclosure 
(2)  is  provided  but  it  should  be  tailored  to  the  procurement 
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b.  Solicit  a  list  of  references  from  all  offerors.  (Gov’t,  Commercial,  State/Local) 

c.  Screen  local  files  and  data  bases  for  pertinent  PPL  (Codes  136.2,  2350,  560) 

d.  Screen  off-site  data  bases  for  pertinent  PPL  (PDREP,  Dunn  &  Bradstreet) 

e.  Conduct  reference  checks  via  enclosure  (1).  (Phone  interview,  mail.  E-mail, 
fax,  etc.) 

f  Provide  all  PPI  to  contractors  for  review/rebuttal.  (Assuming  no  previous 
challenge) 

g.  Receive,  validate,  collate,  and  compare  PPI  for  each  contractor. 

h.  Compare  and  evaluate  offerors  using  all  factors. 

3 .  Additional  discretionary  guidance  is  provided  via  reference  (d).  Contracting  personnel 
should  utilize  this  and/or  other  best  practices  or  lessons  learned  information  to  augment 
the  FAR  requirements. 

PART  n.  PREPARING  PAST  PERFORMANCE  EVALUATIONS 

1 .  As  per  reference  (a),  past  performance  evaluations  shall  be  prepared  after  “each 
contract”  completion  in  accordance  with  the  above  schedule.  “Each  contract”  shall  be 
interpreted  to  mean  each  new  contract  action,  each  delivery  order,  each  task  order,  and 
each  modification  that  would  fall  within  the  dollar  thresholds. 

2.  Enclosure  (1)  shall  be  used  by  contracting  officers  to  evaluate  contractor  performance. 
Inputs  from  material  inspection  and  receiving,  procurement  quality  control,  and  the 
customers  shall  be  utilized  to  the  extent  practicable  in  order  to  obtain  an  accurate 
assessment. 

3.  The  evaluation  shall  be  presented  to  the  subject  contractor  for  review  and  rebuttal.  The 
contrator  will  be  given  a  minimum  of  thirty  days  to  submit  comments.  If  the  evaluation 
cannot  be  agreed  upon  by  both  the  contractor  and  the  evaluator,  the  matter  shall  be 
referred  to  either  the  Contracting  Division  Officer  or  the  Supply  Officer. 

4.  The  evaluations  of  Contracting  Officers  Representatives  (CORs)  may  be  used  for  task 
order  evaluation  provided  that  they  conform  to  the  provisions  of  reference  (a). 

5.  The  evaluation  shall  be  placed  in  the  contract  file  upon  completion/review. 
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